Appendix 1-1 - Long Range Plan 


Oklahoma State University 
School of Media and Strategic Communications 
2019-2021 Growth Initiatives 

INITITAVE #1/STUDENT RECRUITMENT/SATISFACTION 
e MILESTONES 

o Increase awareness of Media and Strategic Communications programs 

o Define recruitment goals 

o Unified/coordinated recruitment effort 

o Define off-campus outreach strategies 

o Strategy to become competitive with Spears School of Business 

o Develop plan to better understand student wants, needs and concerns 

o Develop plan to better understand industry wants, needs and concerns 
e GOAL #1/INCREASE AWARENESS ON CAMPUS/ACTION STEPS 

o Recruiting students to MC 1143 (Media in a Diverse Society) 


1. Communication with academic advisers across campus with course 
information. 


2. Communication with freshmen academic areas similar to SMSC floor. 


3. Print materials on bulletin boards across campus during class registration 
times. 


4. Utilize student media outlets for promoting availability of MC 1143 as an 
elective. 


o Promotional videos/materials/events by Fall 2019 

1. Shanghai video series used as a recruitment tool. 

2. Create online magazine from study abroad content. 

3. Utilize MESA group website promoting student research opportunities. 
o Majors fair in Fall 2019 


1. Coordinate with existing SMSC clubs in promotion of and planning of 
majors fair. 


2. Coordinate with area high schools to make the event a field trip-like activity 
for participating programs. 


3. 


Feature new “Social Media” concentration. 


o SPM 2843/SC 2183 recruitment (Fall 20) 


1. 


Communication with academic advisers across campus with course 
information. 


Communication with freshmen academic areas similar to SMSC floor. 


Print materials on bulletin boards across campus during class registration 
times. 


Utilize student media outlets for promoting availability of SPM 2843/SC 
2183 as electives. 


Scheduling early-morning SPM 2843 section to encourage student-athlete 
enrollment. 


e GOAL #2/INCREASE AWARENESS OFF-CAMPUS/ACTION STEPS 


o Online Skype sessions with high school classes (Fall 19) 


1. 


Coordinate with area high school instructors to hold sessions in their 
classes. 


Use current students to coordinate with regional high schools to hold 
sessions in their classes in recruitment of students. 


o Attend high school student research symposiums (Summer 20) 


1. 


2. 


Compile list of regional high school research symposiums and honor 
student research presentations. 
Send selected faculty and/or students to recruit students at these events. 


o Continuing education classes for high school teachers (Summer 20) 


1. 


2. 


Offer high school teachers from those programs deemed relevant exposure 
to our faculty and their research. 


Consult with high school teachers from programs deemed relevant to 
develop course offering(s) they view as beneficial to themselves and their 
students (e.g., Uses of media in the classroom) 


3. Offer summer seminars allowing high school instructors ability to co-create 


lecture material with SMSC faculty and identify points of interests and 
emphasis relevant to student engagement in communication studies. 


o Ads for Sports Media program at sporting events (TBD) 


1; 


Place advertisements in HS football, basketball programs in targeted HS 
markets (OKC, Tulsa, North Texas) 


Run promotional announcements on video boards at high school stadiums 
in targeted recruitment markets 


Barter arrangement with cable television systems that SMSC provides 
sports programming content for (or insert messages within such 
programming) 


e GOAL #3/IMPROVE STUDENT SATISFACTION/ACTION STEPS 


o Student surveys (actions taken in Spring 19 and future) 


1. 


Consult with students on matters of importance to them as it relates to their 
expectations from the program. 


Consult with industry partners on essential skills needed for students upon 
entering the job market. 


Create a survey using validated scales for those measures deemed of 
importance from student and employer perspectives. 


Include questions on how the students selected an SMSC major, as well as 
exposure to SMSC related promotional material prior to their entry into the 
school. 


o Improved Senior exit interviews (actions taken in Spring 19 and future) 


1. 


Track number of internships students participate in as potential mediating 
variable of post-graduate placement. 


. Track organizational participation as potential mediating variable of post- 


graduation job placement. 


. Track concentration(s) as a potential moderating variable of post- 


graduation job placement. 


. Four-year follow-up survey implemented with SMSC graduates (internal). 


Sequencing (clarify needed class content & where classes fit in degree 
program) 


1. 


Social media concentration reviewed regarding goals, available faculty 
knowledge/resources, and responsible long-term projections for those 
students being recruited to participate on the Tulsa campus. 


Discussion concerning cross-listing entrepreneurial classes from the 
business school as part of the new social media concentration (manifold 
benefit of ingratiating business to our program & potentially mitigating 
further student poaching). 


Discussion on breaking silos between various concentrations (e.g., 
technologies, methods, and necessary student capabilities) in relation to 
new social media concentration; allows for new concentration to be more 
cross-discipline and thus a unifying factor for the school. 


Supervisor evaluation for internships (actions TBD) 


Determine industry expectations (2020-2021) 


Ni 


Coordinate with Tulsa and OKC industry partners to construct reasonable 
understanding of future industry shifts and expectations of student 
competencies. 


Coordinate with each faculty member to evaluate and understand faculty 
perspectives and strengths, vis-a-vis how courses (and research produced) 
help place students in industry (specify what industries). 


Strengthen internal alliances and partnerships with existing campus 
organizations and colleges that can aid in student placement due to their 
specialization in a given industry requiring media-based services. A listing 
of such partners should be compiled. 


Strengthen external alliances and partnerships with existing campus 
organizations and colleges that can aid in student placement due to their 
specialization in a given industry requiring media-based services. A listing 
of such partners should be compiled. 


INITITAVE #2/STUDENT ENGAGEMENT 


e MILESTONES 

o Increase undergraduate involvement in the following 
= Research in support of faculty 
= Student organizations 
= Student media 
= Study abroad 

o Students should have at least one of these [experiences] in their portfolios by 

graduation 


e GOAL #1/PROVIDE LISTING OF RESEARCH OPPORTUNITIES/ACTION STEPS 
o Faculty to provide list to Student Engagement Committee (SEC) (Fall 19) 


1. MESA group research (overseen by Drs. Skye & Asya Cooley)- 
Opportunities include: 

a. Paid and unpaid research assistants conducting open source data 
collection, field research conducting in-depth interviews (Some 
foreign language proficiencies required, conducting trend analysis 
on big data platforms such as gdlet & wits.worldbank. 

b. Paid and unpaid opportunities to participate in grant writing, 
government research projects for SMA, DHS, & DoD; as well as 
opportunity to present research findings to the COE, Joint Chiefs, 
and academic communities. 

c. Paid and unpaid opportunities to produce media content related to 
MESA group research projects for distribution to the U.S. 
intelligence community. 


2. PRSSA research opportunities (overseen by Drs. Skye Cooley & Danny 
Shipka)- Opportunities include: 

a. Researching ways in which the O’Colly Media Group might increase 
its campus presence. OMG will be the Fall 2019-Spring 2020 client 
for the OSU PRSSA club. Members will have the opportunity to 
conduct research, conduct a full campaign on behalf of the OMG, 
and submit their research and campaign results as case studies 
considerations for PRSSA scholarships, awards, and recognition. 


3. Research in Study Abroad (overseen by Drs. Skye & Asya Cooley)- 
Opportunities include: 
a. Spring 2020 trip to Geneva, Switzerland to conduct research on 
non-profits. Student research will be produced as a virtual magazine 
and distributed across campus. Students will be invited to present 


their research in the Wes Watkins Center to their peers as part of a 
scheduled promotion of globally focused student research. 

b. Summer 2020 trip to Shanghai, China to conduct research on 
Chinese media and its intersections with global trends and current 
events. Student research will be produced as individual projects 
approved by the program directors. Students will be invited to 
present their research in the Wes Watkins Center as part of a 
scheduled promotion of globally focused student research. 


o Obtain web domain for list (Fall 2019) 


1. Web domain needed for MESA group. 


o Class list of assignments to SEC (Fall 2019) 


ali 


2. 


SC 3953- Students are assigned 3-homework assignments involving 
application of theory, observation of variables, and collection of data. 
MC 5223- Students are assigned 12-homework assignments in SPSS 
training and required to complete a full research design proposal 
(instruments and SPSS files included) as the final assignment in for the 
course. 


o Make full listing available (Spring 2020) 


e GOAL #2/STUDENT ORGANIZATIONS & MEDIA/ACTION STEPS 


o Proposal for student club requirement on portfolios (Fall 19) 


1: 


SMSC Assessment committee works with SEC on developing proposal in 
Spring 2020 semester for requiring club involvement or student media 
organizations). Among issues to be identified: Minimum level of 
involvement; verification of such involvement within the portfolio; and 
timetable to establish requirement. 


. Bring together SMSC student club and media leaders as well as freshmen 


students for input through surveys, focus groups (Spring 2020). 


. Consult with A&S regarding ability of School to mandate student club 


involvement as part of student assessment activity (Spring 2020). 


. Evaluation of implementation by Assessment Committee along with SMSC 


faculty (TBD). 


INITITAVE #3/SOCIAL MEDIA STRATEGY 


e MILESTONES 


O 
O 
O 


Develop a social media strategy 

Identify most efficient channels for communication 

Identify relevant information for communication and develop a centralized 
resource to access 


e TARGET AUDIENCE 


O 


oOo 0 © 0 0 


Prospective students 
Current students 
SBJ/SMSC Alumni 
Potential donors 
Local/state/national media 
Professionals in the field 


e GOAL #1- ESTABLISHING AND MAINTAINING A SOCIAL MEDIA PRESENCE 


FOR THE SMSC AND THE ACTIVITY OF ITS FACULTY, STAFF & 
STUDENTS (SPRING 2020) /ACTION STEPS 


Create SMSC social media influencer club. Club responsibilities will include 
cultivation of SMSC social media content and brand management; could be 
linked to specific courses and their respective assignments 

Creating monthly analytic reports 

1. Tracking clickthroughs of website content. 

2. Tracking videos watched (e.g., Time Spent Viewing Videos). 


3. On-campus vs. off-campus traffic. 


Develop system allowing faculty, student leaders to share timely news 


1. This should include coordination with Megan Horton at brand management, 


who seeks to create a club in order to cultivate a larger brand awareness 
on social media for OSU. 


2. Provide updates on relevant research, travel, and awards relevant to 
students and faculty with the SMSC. 


3. Use system for recruiting research subjects for faculty, graduate, and 
undergraduate studies. 


o Creating SMSC master calendar of School, University events, etc. 


1. Design electronic master calendar with access given to administrative 
office, faculty and instructors, and designated student media and club 
leaders (designate individual for coordination). 


2. Identify methods for student notification of major events beyond e-mails. 
3. Person coordinating master calendar staying in communication with A&S 
communication staff for sharing information concerning upcoming SMSC 
events or achievements by SMSC faculty, students, and alumni. 
o Ensuring at least 75% of SMSC posts of have still/moving images 
1. Providing list of ideas for faculty members, such as monthly podcasts 
highlighting faculty expertise and ongoing research. 


2. Providing training on equipment and access to SM platforms so that faculty 
members can upload relevant content. 


e GOAL #2- USE SOCIAL MEDIA AS A RECRUITMENT TOOL FOR HIGH SCHOOL 
STUDENTS (SPRING 2020)/ACTION STEPS 


1. Create club of SMSC social media influencers, in coordination with brand 
management, in order to target relevant high school seniors with recruitment 
content created by their former peers. 

2. Conduct focus groups to test social media content effectiveness 


3. Survey incoming students for exposure to social media recruitment content. 


e GOAL #3- USE SOCIAL MEDIA AS A CONTACT TOOL FOR IDENTIFIED 
POTENTIAL DONORS (SPRING 2020)/ACTION STEPS 


1. Create a list of potential donors in coordination with annual giving in order to 
follow those individuals on social media. 


2. Create targeted content, with SMSC social media influencers, to engage 
potential donors and allow them to feel connected to the program. 


INITITAVE #4/FUNDRAISING 
e MILESTONES 
o Creating a fund-raising plan (Fall 2019) 
o Identify top three funding needs (completed) 
o Identify fund-raising mechanisms through 
= Individual interviews 
= Professional contacts 
= OSU Foundation 
= Other options 
e GOAL #1/IDENTIFY CRITICAL NEEDS/ACTION STEPS 
o Faculty development 
1. Develop funding for faculty professional development. 
2. Develop funding for research infrastructure. 
3. Increase funding for faculty travel. 


o Financial aid 


1. Increase funding for scholarships from approximately $100,000 to 
$150,000. 


2. Increase funding for student enrichment scholarships to $50,000 [per year]. 
e GOAL #2/IDENTIFY FUNDRAISING MECHANISMS/ACTION STEPS 

1. Increase Foundation visits to key donors. 

2. Expand scope of solicitation visits to include more mid-career alumni. 


3. Create young alumni group to encourage a culture of support for 
School. 


e GOAL #3/DEVELOP PLAN TO ADDRESS FUNDING GAPS/ACTION STEPS 
1. Meet with new Foundation representative 


2. Develop one-page sheet of funding priorities for Foundation to use on 
donor visits without Director. 


Appendix 1-2 - Sample Ballots 


School of Media & Strategic Communications — Committee Ballot 
2018-2019 


PERSONNEL COMMITTEE 
BALLOT FOR ELECTION OF MEMBERS 


NUMBER TO BE ELECTED: 5 


CANDIDATES ELIGIBLE: Tenured Positions whose budgetary home 
is in the School of Media & Strategic Communications. 


INSTRUCTIONS: Please vote for FIVE (5) tenured members who will serve 
terms on the Personnel Committee. The five faculty members with the most votes will 
serve a one-year term effective September 1, 2018 through August 31, 2019. 


Stan Ketterer 
______Ted Kian 
_—____ John McGuire 

Lori McKinnon 
____ Ray Murray 
____ Joey Senat 


Danny Shipka 


INSTRUCTIONS FOR RETURNING BALLOT: 


Ballot box is located outside of Melissa’s office. Please submit your ballot no later than Wednesday, August 29 @ 5:00pm. 


School of Media & Strategic Communications — Committee Ballot 
2018-2019 


BALLOT FOR ELECTION OF 
ACADEMIC INTEGRITY FACILITATOR 


NUMBER TO BE ELECTED 1 
CANDIDATES ELIGIBLE Tenured & Tenure-track faculty whose 
budgetary Home is in the School of 
Media & Strategic Communications. 
INSTRUCTIONS: Please vote for ONE (1) faculty member who will 
serve as Academic Integrity Facilitator for the school. 
The faculty member with the most votes will serve a 
three-year term beginning Sept. 1, 2018 thru Aug. 31, 
2021. 
Clara Bae 
Skye Cooley 
Jared Johnson 
Ted Kian 
John McGuire 
Lori McKinnon 
Ray Murray 


Joey Senat 


Danny Shipka 


INSTRUCTIONS FOR RETURNING BALLOT: 


Ballot box is located outside of Melissa’s office. Please submit your ballot no later than Monday, 
August 29 @ 5:00pm. 


School of Media & Strategic Communications — Committee Ballot 
2018-2019 


BALLOT FOR ELECTION OF MEMBERS OF THE 
STUDENT SERVICES /EXTENSION COMMITTEE 


NUMBER TO BE ELECTED 1 
CANDIDATES ELIGIBLE Tenured, Tenure-track, and Clinical 
faculty whose budgetary home is in the 
School of Media & Strategic 
Communications. 
INSTRUCTIONS: Please vote for ONE (1) member who will serve 
on the Student Services / Extension Committee. The 
one faculty member with the most votes will serve a 


three-year term effective Sept. 1, 2018 thru Aug. 31, 
2021. 


Stan Ketterer 
Ted Kian 

John McGuire 
Lori McKinnon 
Ray Murray 
Gina Noble 
Joey Senat 


Danny Shipka 


Current members are: Bae, S. Cooley, Johnson, Speed 


INSTRUCTIONS FOR RETURNING BALLOT: 


Ballot box is located outside of Melissa’s office. Please submit your ballot no later than 
Wednesday, August 29 @ 5:00pm. 


School of Media & Strategic Communications — Committee Ballot 
2018-2019 


CURRICULUM COMMITTEE 
BALLOT FOR ELECTION OF MEMBERS 

NUMBER TO BE ELECTED 2 

CANDIDATES ELIGIBLE Tenured, Tenure-track, and Clinical 
faculty whose budgetary Home is in the 
School of Media & Strategic 
Communications. 

INSTRUCTIONS: Please vote for TWO (2) members who will serve a 

term on the Curriculum Committee. The two faculty 


members with the most votes will serve a three-year 
term effective Sept. 1, 2018 thru Aug. 31, 2021. 


Clara Bae 
Skye Cooley 
Stan Ketterer 
Ted Kian 
John McGuire 
Ray Murray 
Gina Noble 
Joey Senat 


Danny Shipka 


Current members are: Johnson, McKinnon, Speed 


INSTRUCTIONS FOR RETURNING BALLOT: 


Ballot box is located outside of Melissa’s office. Please submit your ballot no later than 
Wednesday, August 29 @ 5:00pm. 


School of Media & Strategic Communications — Committee Ballot 
2018-2019 


BALLOT FOR ELECTION OF MEMBERS OF THE 


TECHNOLOGY COMMITTEE 
NUMBER TO BE ELECTED 2 
CANDIDATES ELIGIBLE Committee is comprised of 2 


Tenured /Tenure-track/ Clinical faculty 
serving 2-year terms, and 2 
Adjunct / Visiting faculty serving a 1- 
year term. 

INSTRUCTIONS: Please vote for TWO (2) adjunct / visiting members who will 


serve a one-year term on the Technology Committee, effective Sept. 1, 2018 thru 
Aug. 31, 2019. 


Max Andrews 

Asya Cooley 

Daniel Crutcher 
Jeremy Davis 

Shane Hoffman 
Dave Hunziker 

Tim Jessell 

Julie Johnston 
Nicole Morgan 
Juliana Nykolaiszyn 


Andy Wallace 


Current members are: S. Cooley, Johnson, Shifflett - continuous 


INSTRUCTIONS FOR RETURNING BALLOT: 


Ballot box is located outside of Melissa’s office. Please submit your ballot no later than 
Wednesday, August 29 @ 5:00pm. 


Appendix 1-3 - Administrator Evaluation 


Oklahoma State University Policy and Procedures 


2-0302 
ANNUAL PERFORMANCE APPRAISAL ACADEMIC AFFAIRS 
OF ACADEMIC ADMINISTRATORS August 2017 


POLICY 


1.01 It is the policy of Oklahoma State University that the effectiveness and productivity of 
academic administrators! shall be formally evaluated on an annual basis by the responsible 
administrative supervisor. 


1.02 Nothing in this policy shall alter the at-will employment status of academic administrators. 
(Reference P&P 3-0726, Sec. 3.01 and 3.02) The performance appraisal of academic administrators 
shall be a positive, formative process to determine whether or not the person is successfully 
performing and achieving the established roles and requirements of the position. It shall be a formal 
process of collecting pertinent information which reflects the activities and behavior of the 
administrator, assessing such information, and making a value judgment concerning this assessment 
for the benefit of both the individual and the University. It is to be conducted for the following 
reasons: 


1. To identify through evaluation feedback needed areas of individual professional development. 
2. To improve individual administrative performance. 
3. To help define more clearly individual and organizational objectives consistent with 


institutional missions and goals. 


4. To improve internal communications, administrative teamwork, and overall management of 
the institution. 


5. To reward outstanding administrative performance. 
6. To support the retention and salary processes. 
Ta To enhance accountability to government, regents, faculty, students, and the general public 


and thus improve the credibility of the administrative process. 


' For purposes of this document, academic administrators are those who supervise the activities of 
faculty and/or have responsibilities that impact directly on the instruction, research, or extension/outreach 
functions of the University. Included specifically are the VPAA (Academic Affairs & 
Extension/Outreach), VPR (Research), and their administrators for Instruction, Research, Extension, and 
Academic Services, the Academic Deans and their Assoc./Asst. Deans, College Directors of Research, 
Extension/Outreach and Student Academic Services, School Directors, Department Heads, and Chairs. 
Others may be designated by a Vice President or Dean. 


1.03 If the evaluation process demonstrates that the performance of an administrator is significantly 
below the expectations established for the position, immediate corrective action must be taken by the 
responsible administrator to resolve the deficiencies. 


1.04 Although the final authority for the evaluation of all administrators is held by the President, 
the immediate supervisor shall conduct the actual appraisal using input from faculty, staff and other 
administrators as prescribed in these guidelines. The process for initiating and administering 
programs of performance appraisal for academic administrators is as follows: 


1. The President shall evaluate the Vice Presidents responsible for Instruction, Research, and 
Extension functions in conjunction with an appraisal program for all other Vice Presidents 
and administrators who report to the Office of the President. 


2. The Vice President for Academic Affairs, acting for the President, shall initiate appraisals of 
Academic Deans. Other academic administrators reporting directly to the Offices of 
Academic Affairs and Research shall be evaluated by those Vice Presidents. 


3. The respective Dean of each college shall initiate and administer programs for evaluating 
Associate/Assistant Dean(s); Directors of Extension, Research and Student Academic 
Services; School Directors; Department Heads; and other designated administrative officers 
of his/her college. 


CONDUCTING APPRAISALS 


2.01 Although the actual format may vary to accommodate unique characteristics of the University 
structure and its operating units, the following policies are established to facilitate consistency in the 
administration of performance appraisals. 


Soliciting and Handling Faculty and Staff Feedback 


l. The formal appraisal process must provide an opportunity annually for all faculty and staff 
within each academic unit to provide feedback relative to the performance of the department 
head or school director and for all faculty and staff in each college to provide feedback relative 
to the performance of the Dean and Associate/Assistant Deans. Others who may be affected 
by the decisions and actions of the administrator should also be given the opportunity to 
submit relevant information for consideration by the evaluator. In the case of appraisals of 
Vice Presidents, instead of soliciting feedback from all faculty and staff, the evaluator will 
seek input from the chair of the faculty council. 


2. The procedures for collecting, handling, summarizing, and sharing faculty and staff feedback 
with administrators must ensure confidentiality of faculty and staff responses. 


3. Faculty and staff written feedback will not be directly shared with the academic administrator 
under review and will not be placed in the personnel file of the academic administrator under 
review but will be presented as aggregated themes. 


4. For clarity and transparency, the call to evaluate academic administrators should clearly 
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indicate: 


a. all parties being contacted in addition to the faculty and staff (e.g., staff, advisory 
councils). 
b. the level of confidentiality/anonymity that will be maintained — who will see the raw 


data, how the raw data will be summarized quantitatively and qualitatively, and what 
will happen to the raw data after the appraisal. 

c. how, to whom, and for what purpose the results of faculty and staff feedback will be 
shared. 





Appraisal Criteria 


1. 


The procedures for appraisals must provide an opportunity for participation and input by the 
administrator being evaluated. The individual shall have a right to know the criteria by which 
performance is being evaluated. He/She shall have the opportunity (and is expected) to 
provide information that reflects performance and achievements toward executing the duties, 
responsibilities, and expectations established in a position description or assigned by the 
supervisor. The individual shall be entitled to review a written summary of the appraisal and 
have an opportunity to discuss with the evaluating supervisor the input provided by the faculty 
and the results of the appraisal. The individual may attach a rebuttal to the permanent copy 
of the appraisal record and request a review by the next highest supervisor if differences 
cannot be reconciled. 


The criteria against which performance and productivity are assessed must be clearly 
established and shared with the faculty and other individuals participating in the process. 
Specific criteria may vary according to the complexity, composition, and organizational 
maturity of the area of responsibility for which the individual is responsible, or in relation to 
the constraints within which the individual administrator must function. However, all criteria 
used must be related to the actual duties, responsibilities, and performance expectations 
established for the administrative position. Judgments regarding the individual's overall 
performance and effectiveness must also consider progress toward established purposes (goals 
and objectives), as well as the achievements and methods of the administrator. Criteria may 
include, but are not limited to, the following: 

Planning and achieving organizational goals, objectives and priorities 

Interacting and communicating with faculty, staff, students, and other publics 
Managing and developing fiscal, physical, and personnel resources 

Developing, interpreting, and applying administrative policies and procedures 
Demonstrating professional and academic leadership 

Continuing academic and professional development and achievement 


monaoge 


Procedures 


2.02 


It is the responsibility of the supervising administrator conducting the appraisal to: 


Inform the individual being evaluated of the forthcoming appraisal and the criteria by which 
performance is being judged. 


Work cooperatively with the individual being appraised, appropriate faculty, and staff to 
2-0302.3 


collect information pertinent to the productivity and performance of the administrator being 
evaluated. 


3. Review, assess, and summarize the pertinent information and conduct an appraisal interview 
with the administrator to discuss the results of the assessment. 


4. Provide a written summary of the evaluation that supports the appraisal rendered and outlines 
developmental activities and performance expectations for the coming year. (If performance 
is deficient, a plan of corrective action must be recommended.) 


5. Report the overall appraisals of those evaluated to the next highest supervisor. 


6. Maintain written records of the appraisal in the administrator's personnel file and protect the 
confidentiality of such records. 


7. Follow up on prescribed corrective action if performance was found to be deficient. 


Guidelines Approved: Spring 1994 


Policy Approved: 

Faculty Council, May 10, 2016 

Council of Deans, July 28, 2016 

Faculty Council & Deans Working Group, March 3, 2017 
Legal Counsel, May 2017 

Executive Team, August 2017 
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FLOW SHEET FOR 
ADMINISTRATOR PERFORMANCE APPRAISAL 


Administrative Position Person to Conduct Input Solicited From 


Appraisal 


Dept. Admin. School Admin. or Dean Faculty and staff 

School Admin. Dean Faculty, staff, and dept. admin. 

Dean's Staff (Assoc./Asst. Dean Faculty, staff, dept. and school 

Dean Ext., Res., Stu. Aca. admin. and others as designated by 

Serv., and other aca. admin. Dean 

as designated by the Dean) 

Dean VPAA Faculty, staff, dept., and school 
admin. and others as designated by 
VPAA 

VP's Staff Appropriate VP Faculty through Faculty Council 

(Instr., Res., Ext., Stu. Aca. Chair, Deans and others as 

Serv.) designated by the VP 

VPAA (Aca. Affs., Ext.), President Faculty through Faculty Council 


VPR (Res.) 


2-0302.5 


Chair, Deans & Unit Heads 
reporting directly to VP Offices 


ATTACHMENT #1 


CONFIDENTIAL 
APPRAISAL of DEANS 


Instructions: Your administrator is expected to demonstrate proficiency in leadership, 
administration, and communication. Please rate each of the following competencies of performance 
during this appraisal period. Insert one of the six appraisal indicators for each statement. 


5 = Strongly Agree; 4 = Agree; 3 = Neutral; 2 = Disagree; 1 = Strongly Disagree; 0 = No 
Information 


l. The dean has my trust and respect. 

2. The dean is fair. 

3. The dean is effective in discharging the teaching mission of the unit. 

4. The dean is effective in promoting the quantity and quality of faculty scholarship. 

5. The dean is effective in promoting the extension, outreach, and engagement missions of 


the college. 


6. The dean has a clear, articulated vision for the college and effectively works to achieve 
that vision. 


iP The dean is an effective communicator. 
8. Overall, the dean is effective. 
9. Indicate the category that best describes your position. 


1 = faculty; 2 = college/unit administrator; 3 = college/unit staff; 4 = external constituent 


Comments: 
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ATTACHMENT #2 


CONFIDENTIAL 
APPRAISAL of ASSOCIATE DEANS 


Instructions: Your administrator is expected to demonstrate proficiency in leadership, 
administration, and communication. Please rate each of the following competencies of performance 
during this appraisal period. Insert one of the six appraisal indicators for each statement. 


5 = Strongly Agree; 4 = Agree; 3 = Neutral; 2 = Disagree; 1 = Strongly Disagree; 0 = No 
Information 


l. The associate dean has my trust and respect. 

2. The associate dean is fair. 

3. The associate dean is effective in accomplishing the missions of her/his assignment. 
4. The associate dean is available to faculty, staff, and students for consultation. 

5. The associate dean follows through on commitments. 

6. The associate dean is an effective communicator. 

7. Overall, the associate dean is effective. 

8. Indicate the category that best describes your position. 


1 = faculty; 2 = college/unit administrator; 3 = college/unit staff; 4 = external constituent 


Comments: 
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ATTACHMENT #3 


CONFIDENTIAL 
APPRAISAL of UNIT HEADS AND DIRECTORS 


Instructions: Your administrator is expected to demonstrate proficiency in leadership, administration, 
and communication. Please rate each of the following competencies of performance during this 


appraisal period. Insert one of the six appraisal indicators for each statement. 


5 = Strongly Agree; 4 = Agree; 3 = Neutral; 2 = Disagree; 1 = Strongly Disagree; 0 = No Information 


LEADERSHIP 
l. Demonstrates initiative in the development and improvement of the respective unit. 
2. Functions effectively under pressure. 
3. Earns the confidence, respect, and trust of others. 
4. Maintains appropriate confidentiality in relationships 
5. Handles difficult situations involving people skillfully. 
6. Deals with individuals fairly. 
T Establishes reasonable goals and makes them known to department members. 
8. Accomplishes administrative goals and objectives productively. 
9. Provides visionary and innovative leadership. 
Comments: 
ADMINISTRATION 
10. Assigns duties and tasks clearly. 
11. Delegates authority when appropriate. 
12. Follows through on commitments. 
13. Carries out the policies and procedures of the university appropriately. 
14. Establishes reasonable goals and makes them know to department members. 
15. Supports affirmative action efforts within the respective unit. 
16. Encourages professional or personal development. 
17. Supports effective teaching by all faculty. 
18. Supports experimentation, research, and publication by all faculty. 
Comments: 
COMMUNICATION 
19. Provides accessibility to faculty, staff, and students for consultation. 
20. Respects diverse opinions and ideas. 
21. Promotes the unit to the community outside the university. 
22. Demonstrates a helpful attitude toward students, faculty, and staff. 
23. Represents those in the unit to superiors and the rest of the university effectively. 
24. Clearly communicates with students, faculty, and staff. 
Comments: 
25. Indicate the category that best describes your position. 


1 = faculty; 2 = college/unit administrator; 3 = college/unit staff; 4 = external constituent 
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Appendix 1-4 - Workload Policy 


School of Media & Strategic Communications 
Faculty Workload Policy (Approved by faculty 4/20/18) 


PRINCIPLES AND GOALS: 


The workload policy of the School starts from the conviction that faculty members are highly trained 
professionals and are to be treated as such by administrative units at all levels. Academic excellence is 
inextricably linked to the principle of academic freedom. Therefore, faculty activity must retain a high level of 
personal autonomy; indeed, excessive administrative control over faculty time and activity is deleterious to 
the establishment and maintenance of high standards of academic performance. 


For purposes of measurement and assessment, faculty responsibilities are customarily divided in to three 
areas: teaching, research, service/extension. These areas frequently overlap, and categorization of faculty 
activity by one of these areas is sometimes artificial. Moreover, the activity and emphasis of an individual 
faculty member may vary over time. Opportunities, interests, and the needs of the school are all subject to 
change over time and will influence faculty activity. Therefore, the workload configuration for each faculty 
member is to be negotiated individually with the school director on an annual basis, either as a part of the 
yearly Appraisal and Development (A&D) process or in a separate subsequent individual meeting. In some 
cases, alterations to a typical workload model may be appropriate. These alterations may be requested by the 
faculty member to allow for additional focus on an area of strength or may be assigned by the school director 
in consultation with the faculty member (see below for specifics). 


Whereas teaching and research activities may often overlap in a general sense, it is recognized that research 
and services/extension activities are strongly and adversely influenced by the amount of time directly devoted 
by faculty members to the instructional mission of the school. Faculty members with heavier teaching loads 
generally do not have the time and or energy to focus on producing original research, extension activities, or 
the pursuit of external funding available to those with lighter teaching loads. 


In the allocation of teaching loads among faculty members, the following principles are to be respected by the 
school director: 


1. Equal burden-sharing. Effort will be made to equitably distribute teaching assignments after taking into 
account the ranks, tenured or tenure-line status, research expectations, research foci, teaching 
experience, industry experience, skillsets, and educational backgrounds of faculty members. 


2. Equity in awards. In allocation of rewards, outstanding instruction is to be weighted equally with 
outstanding research. Faculty members who excel in the classroom are to be equally eligible for any 
potential rewards, financial and otherwise, as those with outstanding research and publication records. 


3. Consideration of expertise, interests, and desires. In assigning teaching duties, the school director shall 
take into consideration the professional interests and specialization of faculty members. Whenever 
possible, course assignments shall be consistent with the academic specialization of each faculty member. 
Although not always possible, faculty members should generally be assigned courses they desire to teach 
and are in line with their expertise. However, faculty must be flexible in their desired choices by listing at 
least five SMSC courses regularly offered in the SMSC undergraduate and graduate curricula that they are 
willing to teach through a survey of faculty teaching preferences that is to be distributed by School 
administration every two years. 


4. Equal opportunity for control over career path. Individual faculty members shall be afforded opportunities 
to alter the balance among professional activities on an equal basis. 


5. Consideration of junior faculty members. Since research is a major element of promotion and tenure 
decisions, untenured faculty members shall be given reduced teaching loads when possible in order to 
facilitate their efforts to build publication records. 


6. Advanced notice for teaching assignments: All faculty should be informed of their tentative course 
assignments and the area heads consulted about course offerings in their programs before a full draft of 
the overall schedule is sent to faculty in advance of each term. This provides faculty more time to prepare 
for upcoming semesters and to raise any concerns with administration before the final schedule is 
published. 


7. Time allocated for research focus: Unless requested otherwise or agreed to by individual faculty, tenure- 
line faculty on 2/2 fall/spring loads should be limited to teaching classes and labs that collectively meet no 
more than three days per week to allow time to focus on research. Tenure-line faculty on a 3/2 or 2/3 
fall/spring load should be limited to teaching classes and labs that collectively meet no more than four 
days per week to allow time to focus on research, although administrators should strive to limit teaching 
days for all tenure-line faculty, who have at least 30% of their workload assignment dedicated to research, 
to three days or less per week. Those figures do not include any courses that are counted as overloads, or 
taught separately through outreach or are outside of a faculty member’s base fall-spring courseload (e.g., 
a tenure-line faculty member requesting a course to teach during an intersession could be assigned class 
meetings five days per week). 


8. Engagement with students: As a professional-oriented School, faculty are expected to interact with and 
assist students outside of the classroom. At a minimum, faculty who are teaching any courses that meet in 
person must post at least two available office hours per week in syllabi for that semester. These office 
hours can be the same for multiple courses (e.g., 8-11 a.m. on all syllabi for all courses). Any professor who 
teaches fully online courses must post a minimum of one virtual office hour per online class. 


In allocation of teaching loads the following additional factors are to be considered by the school director: 


1. Level/type of course. 

2. Number of required contact minutes with students (i.e., lecture and lab meeting times) assigned to the 
course instructor as part of the course. 

Size of course enrollment. 

Extent and number of course preparations by faculty members. 

Demands of university service activities on faculty time. 

Demands of professional development activities on faculty time. 


OY E 


In all cases, assignments, judgments, and evaluations made by the school director in consideration of the 
above principles and factors shall be consistent with the FTE allocation for each faculty member. 


In all cases, assignments, judgments, and evaluations made by the school director shall be consistent with the 
availability of resources. 


TEACHING LOAD ASSIGNMENT POLICY: 


Untenured, tenure-track faculty members shall be afforded a 2/2 course load (12 teaching hours total) per 
academic year whenever possible. Under no circumstance should the course load of an untenured, tenure- 
track faculty member ever exceed 2/3 or 3/2 (15 teaching hours total) per academic year. In the first academic 
year of appointment, an untenured assistant professor shall normally be afforded a 1/2 or 2/1 course load (9 
teaching hours total). Additionally, in the year after successful reappointment (i.e., generally a faculty 
member’s fourth year on the tenure clock), an untenured assistant professor shall normally be afford a course 
release, allowing that faculty member to revert back to a 2/1 or 1/2 load for that one academic year. These 
assignments shall be arranged by the school director, in consultation with the faculty member, and subject to 
the principles articulated in the workload policy. 


Tenured faculty members generally maintain an annual 2/2 (12 total teaching hours) or 3/2 or 2/3 (15 total 
teaching hours) over the fall/spring academic year. Tenured faculty may opt for a higher teaching load per 
semester, which would be reflected in FTE documentation. The teaching load for clinical faculty, lecturers, and 
visiting (teaching) assistant professors is generally a 12-hour load per semester or as determined by the school 
director. This document does not recognize intersession, summer, or overload teaching assignments. These 
hours are voluntary and are accounted for outside of the faculty FTE. 


Although these percentages may vary by individual faculty based on assignments, for purposes of 


performance assessment, the difference between the four loads may breakdown as follows with hours in 
parentheses signifying teaching hours taught over the combined fall/spring terms: 


2-2 load (12 hrs.) 3-2 or 2-3 (15 hrs.) Clinical Faculty (24 hrs. Lecturers/VAP (24 hrs. 


(T/TT) (T/TT) 
Teaching 40% 50% 90% 100% 
Research 50% 40% 0% 0% 
Service 10% 10% 10% 0% 


This choice is subject to review and alteration as part of the annual Appraisal and Development (“A&D”) 
process involving the individual faculty member and the school director. Changes in individual load 
assignments are to take effect in a manner consistent with the school’s course scheduling deadlines. Tenured 
and tenure-line faculty members’ base (fall/spring) teaching loads should not be increased from the terms of 
their original offer letters unless a faculty member receives a rating of below expectation or lower on 
research/scholarship for three consecutive years on a faculty member’s A&D. However, tenured and tenure- 
track faculty members can be assigned up to one teaching-credit hour over their combined assigned fall/spring 
teaching loads due to credit for a separate lab or extended-minutes lecture/lab courses. This extra hour must 
be accounted for in their A&D, but not for their teaching loads or annual workload percentage assignments. 
For example, a tenure-line faculty member on a 2/2 teaching load may be assigned one extended-minutes 
lecture/lab combo or a course with a separate lab over the fall/spring terms without affecting that faculty 
member's teaching load. Any additional such assignment must result in an adjustment of that faculty 
member’s teaching load and workload assignment. 


Teaching Assignment Credits and Guidelines Based on Contact Minutes Required with Students Per Class: 


1. (a) 50-minute, 3-day-a-week undergraduate lecture classes, (b) 75-minute, 2-day-a-week classes, and (c) 
lecture/lab courses all worth 3 credit hours that require 170 total minutes or less of instructor contact minutes 
with students per week all count as 3 teaching hours for teaching loads and workload assignments. 


2. Online and hybrid courses worth 3 credit hours and taught within load during the fall or spring semesters 
count as 3 teaching hours for teaching loads and workload assignments. 


3. 170-minute, one-day per week graduate courses worth 3 credit hours count as 3 teaching hours for 
teaching loads and workload assignments. 


4. 100-minute lecture courses worth 3 credit hours with a separate lab up to 110 minutes or extended- 
minutes combined lecture/lab courses that require more 171 or more direct contact minutes with students 
count as 4 teaching hours for teaching loads and workload assignments. However, faculty may be assigned 
one of these courses annually over the fall/spring terms without an adjustment in teaching loads or workload 
assignments. If assigned two or more extended-minutes courses over the fall/spring terms, then all extended- 
minutes courses must be counted for teaching loads and workload assignments. 


5. Each subsequent lab (no more than 110 minutes each) added to a teaching assignment will count an 
additional hour to a faculty member's teaching load for teaching loads and workload assignments. Thus, a 
100-minute lecture course with two separate 110 minute labs counts as 5 teaching hours even though the 
class is worth 3 credit hours for students. A 100-minute lecture course with four separate 110 minute labs 
counts as 7 teaching hours. If mutually agreed upon by the faculty member and director, this can be adjusted 
down to account for smaller lab sections. For example, a faculty member who could teach three full or near- 
full to capacity separate labs as part of a course, but requests four labs with smaller enrollment to provide 
more individual attention to students would only receive 6 teaching hours for that course and four separate 
labs, so long as that is agreed to in advance by both the faculty member and director. 


6. Preference will be to assign courses with additional labs taught by the course instructor to non tenure-line 
faculty. No tenured or tenure-track faculty member will be assigned more than one course in their annual 
base fall/spring load that includes more than 170 contact minutes (lectures and labs) with students for three 
(3) hours credit unless that faculty member requests assignments of extended-minutes courses that better fit 
her/his expertise. If so, that faculty member’s workload assignment and A&Ds will be adjusted to account for 
the extra time required in the classroom. Faculty may, during the annual A&D process, agree to additional 
lecture/lab courses in exchange for an adjustment in teaching and research recent efforts. 


7. Courses counting for 1 or 2 credit hours count as 1 or 2 teaching hours, respectively, in the teaching model. 


RESEARCH 


Housed at a land-grant, research-intensive university, primary mission of the School is to promote scholarly 
research and professional performance. Accordingly, most tenured and tenure-line faculty carry reduced 
teaching loads to allow time for research. Thus, faculty with lower teaching loads will have a greater 
expectation for producing scholarship. In the processes of workload assignments, FTEs, A&Ds, and various 


types of rewards, the following types of primary research produced by SMSC scholars are to be recognized 
and prioritized by the Director, although other types of scholarship should be recognized on a case-by-case 


basis: 


1. 


4. 


6. 


Refereed and peer-reviewed academic journal articles and books (authored and edited). These are the 


most common type of scholarship outlet for research produced in the School and should be factored 
into workload assignments and A&Ds. Factors to be considered in the evaluation of these publications 
include (A) quality of journal based on acceptance rate, publisher, and affiliation; (B) solo vs. group 
authorship; (C) author ordering (e.g., first author on a journal article receives more credit than being a 
third author); and (D) reputation of publisher of books and handbooks. 


External grants. The successful procurement of external grants as a PI or co-PI should be recognized in 
a faculty member’s A&D and possibly affect that member’s workload assignment as noted above. 
Unsuccessful attempts to attain external funding should be positively noted in faculty members’ A&Ds 
but have no affect on workload assignments. 


Book chapters and refereed monographs. These publications are valuable, but recognized ona 
secondary level compared to refereed journal articles and authoring/editing books. Factors to be 
considered in the evaluation of these publications include (A) solo vs. group authorship; (B) author 
ordering (e.g., first author on a journal article receives more credit than being a third author); (C) 
reputation of publisher of books and handbooks; (D) reputation of editor or authors of a book or 
handbook. 


Refereed conference papers and presenting papers as part of refereed conference panels, published, 


editor-reviewed academic articles, and published book reviews in refereed journals. These will be 
considered in A&Ds, but do not affect annual workload assignments. Factors to be considered in the 


evaluation of these publications include (A) solo vs. group authorship; (B) author ordering (e.g., first 
author on a book chapter receives more credit than being a third author); (C) reputation of conference 
and/or sponsoring organization; (D) publisher of editor-reviewed academic journals. 


Creative projects. Due to its ties and need to stay relevant with the industry, these types of creative 
works should be given equal credit to more traditional outlets for scholarship. However, to receive the 
highest level of credit equivalent to research articles, books, and external grants, creative projects 
must be recognized in juried and/or peer-reviewed competitions and require extensive time to 
complete. Factors to be considered in the evaluation of these publications include (A) reputation of 
conference and/or sponsoring organization; (B) published reviews of the creative work; (C) awards won 
via this project; (D) solo vs. group authorship; (E) author ordering, although serving as last producer 
after a list of students must be viewed favorably). 


Internal grants. These are to be recognized as a successful means of junior, tenure-line faculty 
advancing their careers in A&Ds, but are not factored into workload assignments. 


Course Release Reward System for Research/Creative Works Production 


Faculty members with 15-hour annual teaching loads (3/2 or 2/3) or higher who are not already receiving a 
course release or course reduction for any purpose may qualify for a reduced teaching load for up to one 
course annually in either the fall or spring semesters through meeting any of the criteria below. However, 


faculty assigned teaching loads cannot be reduced to lower than 12 hours (fall and spring terms combined) 

by exceeding the output required below. Faculty must provide notice of eligibility for a potential course 
reduction when submitting the annual faculty appraisal and development program form. Faculty are not 
eligible for two course reductions in the same year through the research/creative works formula below unless 
they can potentially buy out multiple courses through successful procurement of an external grant. In rare 
cases, a faculty member’s earned course reduction could be banked but delayed a year, because another 
faculty member from the same area of teaching expertise already earned a course reduction and thus the 
School might have difficulty staffing courses in that area if both faculty received course reductions in the same 
academic year. Further, while intra-department collaborations are strongly encouraged, credit toward a 
potential course reduction earned from a book that involves multiple School faculty members will only go 
toward the faculty member in the earlier ordering of authorship of that book. The same rule does not apply 
for journal articles, where both faculty may receive credit toward a potential course reduction. 


1. Publication of an average of at least one refereed article per year in a quality journal over a three-year 
period with at least 50% of that faculty member’s publications as lead/solo author, not to exceed two 
years without additional published work. (For example, a faculty member who published three or more 
articles in one year would still be limited to three years of reduced course load on the collective basis 
of work if that faculty member does not have any articles published in years No. 2 and No. 3 of that 
period). Published works for this system and for A&Ds may be counted for only one year, either the 
year that is in press or the year that it is published. 


2. Procurement of a contract for a book-length manuscript or other major work (e.g., computer 
programs) from an established and recognized publishing house, provided that the work in question is 
either a scholarly work or a textbook, including new editions of a textbook already in circulation. Such a 
contract qualifies the faculty member for a reduced teaching load for one semester of one year. 


3. Publication of a book (scholarly or text) through a major publisher or as part of a national series as 
author or co-author qualifies the faculty member for a reduced teaching load for two semesters over a 
two-year period. 


4. Publication of a book (scholarly or text) as editor or co-editor qualifies the faculty member for a 
reduced teaching load for one semester. 


5. Procurement of a grant from an external source (i.e., outside the university) of $10,000 or more as a Pl 
or Co-PI qualifies the faculty members involved for reduced teaching loads for one semester or the 
duration of the project if less than two years, after which the reduced load may be renewed or 
cancelled depending upon the funding status of the project. Being listed as a secondary researcher 
(non-PI or co-Pl) on an external grant is credited in a faculty member’s A&D, but does not affect 
workload assignments or teaching loads. 


6. Publication of a creative project that takes extensive time (e.g., full documentary counts, but a column 
in the Stillwater News Press does not) through a juried or peer-reviewed competition as lead/solo 
director/producer/author, etc. or as a secondary director/producer/author, etc. in a work involving 
OSU students could potentially qualify a tenured faculty member for a reduced teaching load for one 
semester. To qualify, this project must take extensive time to complete. 


7. Faculty members may request release from teaching responsibilities altogether for one semester to 
pursue a specific research or professional activity. Such requests are subject to the terms of the 
Research Leave Policy. 

SERVICE 


This proposal calls for establishment of THREE separate service categories for the School—Academic-Internal, 
Academic-Academy and Applied-External. Faculty are encouraged to volunteer for service that best fits their 
interests and expertise. The director is to equally recognize the value of all three types of service in doing 
A&Ds, but that does not mean that all activities falling under the various types of service must be accounted 
equally. For example, serving as an ad-hoc reviewer for a single paper/abstract submitted to a scholarly 
conference is not equivalent service to being on an editorial board of a top scholarly journal. 


Examples of Academic-Internal service would include: 


Membership on School’s permanent committees (e.g., Personnel, Technology); 
Membership on School’s job search committees; 

Membership on College/campus committees (e.g. A&S council, etc.); 

Organizing and directing SMSC sponsored events for high school, college students; 
Advising SMSC student organizations; 

Serving as an area head for one of the School’s three undergraduate programs; 
Making academic presentations to campus groups (outside of SMSC). 


Examples of Academic-Academy service would include: 


Service as officer and or conference planner for national-international organizations (AEJMC, BEA, NCA, 
ICA, etc.); 

Service to state academic groups such as OBEA; 

Serving on editorial review boards; 

Reviewing papers for journals and or conferences; 

Serving as editor (or guest editor) of academic journals; 

Serving as outside reviewer for tenure and promotion cases from peer institutions. 


Examples of Applied-External service would include: 


Presenter/panelist in professional workshops, conferences; 

Used as news source for mass media story (print/video/online); 

Working as professional consultant/advisor/board member for outside media, a professional or 
academic organization, and/or for a strategic communication project or campaign. 


Appendix 2-1 - Internship Application 


LP sero of Media & Strategic Communications 
Oklahoma State University 
Gina J. Noble 
associate director of undergraduate studies & associate professor of professional practice 
405-762-6028 (cell) or gina.noble@okstate.edu 











Admission to SC 3600 — Strategic Communications Internship or SPM 3500 - Sports Media Internship - is 
permitted only after the student has secured an internship position at an approved organization and has 
received written approval from professor Gina Noble, faculty adviser for internships. 


To apply for academic credit for an Internship, complete this form and submit it via email to professor Noble @ 
gina.noble@okstate.edu. NOTE...PAPER COPIES ARE NOT ACCEPTED — YOU MUST SEND A 
DIGITAL COPY. No exceptions. If approved, you will receive a digital copy of this form with professor 
Noble’s signature. Print the form, and take it to your academic counselor to complete enrollment. NOTE..,you 
may not begin counting internship hours until you are enrolled in the class. 





Date of Application: CWID#: 








Student Name (Print): 
Address: 


Phone: 








OSU email: 


Phone: 





Degree: 
Are you earning a Bachelor of Science or Bachelor of Arts? 


Expected date of graduation: 
Overall GPA: GPA in major: 








Place an X next to the courses you have successfully completed: 


— MMJ 3263 — Reporting semester completed 
____ MMJ 3153 — Fundamentals of Audio Visual semester completed 
— SC 3353 — Persuasive Writing semester completed 
___ SC 3753 — Graphic Design semester completed 


How many credit hours do you want to earn?: 1, 2or 3 
One hour of credit = 60 hours of internship work / Two hours = 120 hours / Three hours = 180 hours 


This internship will appear on my enrollment Fall _ Spring _ Summer 
| will complete this internship during the Fall _ Spring _ Summer 
| certify that | am not related (family or marriage) to the internship supervisor or any owners or 
managers of the company. Failure to disclose this information will result in an F in this 


course. 
| do not have any relatives who own or manage this company. 


Student Signature: Date: 





Appendix 2-2 - Internship Evaluation Form 


COLLEGE OF ARTS & SCIENCES 


School of Media & Strategic Communications 


id 
OKLAHOMA 


UNIVERSITY 
=== 





206 Paul Miller Building 
Stillwater, OK 74078-4053 


P: 405-744-6354 
F: 405-744-7104 


Internship Supervisor Evaluation Form 
Spring 2019 





Internship Supervisors... 
please email completed form no later than May 3, 2019, to: 
gina.noble@okstate.edu 











Intern’s Name: 





Place of Internship: 





Dates of Internship: 





Date of Evaluation: 





Name and Title of Supervisor completing evaluation: 


Supervisor's phone number: 





Supervisor’s email: 





NOTE: It is important that the “Internship Supervisor” review this 
evaluation with the student. 


Date evaluation reviewed with student-intern: 





Student signature: 





Supervisor signature: 





Overall Evaluation of Intern 


1. Please describe the student’s internship duties with your organization. 


2. Please evaluate the student’s performance in terms of her/his interpersonalrelations 
with supervisors, colleagues and public contacts. 


3. Please provide comments regarding the intern’s overall performance during the 
internship. This includes any advice, praise and/or constructive criticism. The goal of 
constructive criticism is to help the student improve his/her skills before graduation. 


4. If applicable, please provide comments regarding the student’s writing ability. 


5. If applicable, please provide comments regarding the student’s critical thinking skills? 


6. If applicable, please provide comments regarding the student’s ability to follow 
directions and work with minimal supervision. 


7. If applicable, please provide comments regarding the student’s time management 
skills. 


8, Please provide any other comments you feel are necessary to help Oklahoma State 
University’s School of Media & Strategic Communication prepare its students for 
internships and the workforce. 


9. What software was the student expected to know prior to beginning the internship? 


10. Was the intern paid for this internship? If so, what was the hourly wage? 


Skill and Knowledge Evaluation 


The student intern has not yet completed degree requirements for graduation. Bearing this in 
mind, please rate her/him on the list of skills below. Use the ranking scale that follows and place 
the appropriate mark by each item: “NA” = not applicable, “F” = unsatisfactory, 

“D” = Fair, “C” = Good, “B” = Very Good, “A” = excellent. 


(NOTE: It is important that the “Evaluator” review this evaluation with the student before 


submitting it to the supervising instructor. 





(F) 


Not Applicable 





T| Unsatisfactory 
O| Fair (D) 

O| Good (C) 

W| Very good (B) 


D| Excellent (A) 





1. Understands the fundamental communications challenges in 
specific assignments. 





2. Recognizes target audiences and can direct communication to 
them effectively. 





3. Thinks creatively with assignments. 





4. Writes with appropriate style. 





(Sz) 


. Writing skills. 





6. Attention to details. 





7. Ability to deal with ideas. 





8. Overall ability to visualize situations. 





9. Computer skills. 





10. Photography skills. 





11. Design and layout skills. 





12. Interpersonal skills. 





13. Other 





























Recommended Internship Grade (please circle one grade): A B C D F 





The following are the overall learning outcomes expected of all graduates from the 
School of Media & Strategic Communications. These reflect the core values and 
competencies specified by The Accrediting Council for Journalism and Mass 
Communication as expected of all graduates of an accredited program. This part of the 
evaluation is intended to assist us in improving our program to better facilitate these 
outcomes. 


On a scale from one to seven, please indicate to what extent you believe the student 
demonstrates the following characteristics. Some of these may not be applicable, but 
we are interested in the skills and abilities you have observed while the student worked 
under your supervision. 
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1. An understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass 
communications. 





2. An understanding of the relevance of human 
diversity in mass communications. 





3. An understanding of the history and social role of 
mass communications. 





4. Critical, creative and individual thinking. 





5. An understanding of the relevant theories and 
concepts of mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 





7. Appropriate writing, editing and production techniques 
in mass communications. 








8. An understanding of relevant planning and 
management methods in mass communications. 


























Thank you for giving an OSU student the opportunity to 
work with you and your organization. If you would like to 
post an open job or internship opportunity on our student 
page, please send a description to 


gina.noble@okstate.edu 





Appendix 2-3 - Internship Sites 


Internship sites 









Akron Rubber Ducks Akron 












Appren Media Group Alpharetta 
NewChannel 20 Amarillo 


American Quarter Horse Association Amarillo, Texas 











Asheville City Soccer Club Asheville 
Nova Peaks Aurora, Colorado 
Austin Radio Network Austin 


KTBC Austin 
Austin, Texas 


















Packed Party Austin, Texas 
Sherri Hill, Inc. Austin, Texas 


Sparrows Baseball Club Burbank 
















Hornets Sports & Entertainment Charlotte 
NASCAR Productions Charlotte 
DDS Dentures+Implant Solutions Checotah, Oklahoma 


Munoz Agency Cincinnati 
WBOY-T Clarksburg 





Colorado Springs Fine Arts Center Colorado Springs 
The Winning Edge Leadership Academy Cumming 


City of Dalls Dal 






















Cumulus Radio Dal 
Dallas Stars Dal 
Learfield IMG College Dal 


Plug Public Relations Dal 
RoosterTeeth Dal 













Saatch & Saatch Dal 
Studio 11 Design Dal 


The Dallas Morning News Dal 

















The Lewer Companies Dal 
Zeal Co. Dal 
Drumright Gusher & Yale News Drumright, Oklahoma 


Edmond Sun Edmond 
Life Church Creative Media Edmond, Oklahoma 














GEFCO, Inc. Enid, Oklahoma 
KNWA/KFTA Fayetteville 


CBS 11 Fort Worth 

















Alcon Marketing Fort Worth, Texas 
Frisco Roughriders Frisco 
Curls LLC Frisco, Texas 


WOOD TV Grand Rapids 
Grove 












Arrowhead and Cherokee Yacht Clubs and Marinas Grove, Oklahoma 
WSSP Radio Hales Corners 


Serendipitous Filmes Halton City 















JDA Software Group Irving, Texas 
The Leaven Kansas City 
Government Employees Health Association Kansas City, Missouri 


Wunderman Thompson Health Kansas City, Missouri 
WATE-TV Knoxville 









ESPN Lake Buena Vista 
KWSO Lawton 


Waterski America Lewisville, Texas 




















Clammr Los Angeles 
Hello PR Group Los Angeles 
Hollywire Los Angeles 


Mandt Brothers Productions Los Angeles 
Sports Action, LLC Louisville 













Miami-News Record Miami 
J&J Broadcasting Mount Vernon 


WKRN Nashville 
















New Braunfels, Texas 
New York City 
Norman, Oklahoma 
Oklahoma City 


Reach LLC Nashville, Tennessee 
Schlitterbahn Waterpark & Resorts 













Ackermann McQueen Oklahoma City 
American Red Cross Oklahoma City 
Anglin Public Relations Oklahoma City 


Brides of Oklahoma Oklahoma City 








Internship sites 


Oklahoma City 
Downtown OKC, Inc. Oklahoma City 





Dress for Success Oklahoma City 
Gaylord-Pickens Museum Oklahoma City 


Griffin Communications Oklahoma City 





Juvenile Diabetes Research Foundation Oklahoma City 
KOCO OKlahoma City 
KWTV News 9 Oklahoma City 


Legacy Food Hall, Inc. Oklahoma City 
Lilyfield Communication Oklahoma City 





Oklahoma City Thunder - Corporate Communications Oklahoma City 
Oklahoma House of Representatives Oklahoma City 


Oklahoma Living Magazine Oklahoma City 





Saxum Public Relations Oklahoma City 
Schnake Turnbo Franks PR OKlahoma City 
Oklahoma City 


The Buzz Brand Oklahoma City 
The Journal Record Oklahoma City 





The Oklahoma Media Co. Oklahoma City 
Tyler Media Oklahoma City 


Perry Daily Journal Perry 





Star Local Media Plano 
Prestonwood Christian Academy Plano, Texas 
Lennox International Richardson, Texas 


United Shore Professional Baseball League Rochester 
G2 Media Group LLC Sallisaw 





KSAT-TV San Antonio 
The Mountain Press Sevierville 


Beacon Public Relations Stillwater 





City of Stillwater - Communications Office Stillwater 
Edmon Lowe Library Communications Office Stillwater 
KOSU Stillwater 


Michael O'Neill Marketing Stillwater 
Orange Power Studios Stillwater 





OSU Admissions Stillwater 
OSU Alumni Association Stillwater 


OSU Alumni Association Stillwater 





OSU Athletics - Marketing Stillwater 
OSU Athletics Office Stillwater 
OSU Brand Management Stillwater 


OSU Career Services Stillwater 
OSU Center of Executive and Professional Development Stillwater 





OSU College of Education Communications Stillwater 
OSU Communications Office Stillwater 


OSU Department of Wellness Stillwater 





OSU Foundation Stillwater 
OSU Marketing Stillwater 
OSU New Product Development Services Stillwater 


OSU New Student Orientation Stillwater 
OSU Outreach and Communicatins Stillwater 





OSU Student Union Marketing Stillwater 
OSU-ITLE Stillwater 


Stillwater Area United Way Stillwater 





Stillwater News Press Stillwater 
Team Radio Stillwater 
Stillwater 


Syracuse University Athletics Syracuse 
The Tacoma News Journal Tacoma 





Prospect Wire Baseball Tampa 
KVOA-TV Tucson, Arizona 


BOK Center Tulsa 





Byers Creative Tulsa 
Emerge Marketing & PR Tulsa 
Griffin Communications Tulsa 


Hampton Creative Tulsa 
Jones Brown PLC Tulsa 





KJRH-TV News Channel 2 Tulsa 
KOKI Tulsa 
Tulsa 


KOTV News On Six Tulsa 








Internship sites 


KTUL Tulsa 
Oklahoma Magazine Tulsa 





Paradigm Shift Tulsa 
SixPR Tulsa 


SMG - Tulsa Cox Business Center Tulsa 





Station8 Branding Tulsa 
TD Williamson Tulsa 
Tulsa Oilers Hockey Tulsa 


University of Tulsa Athletics Tulsa 
Wild Honey Weddings Event Planning and Design Tulsa 





Resolute Public Relations Tulsa 
Schnake Turnbo Franks PR Tulsa 


Tyler, Texas 





International Justice Mission Washington D.C. 
US Office of the Vice President - Mike Pence Washington D.C. 
Washington, D.C. 


Office of Sen. James Inhofe Washington, D.C. 
The White House Washington, D.C. 





U.S. House of Representatives Washington, D.C. 
The Greenbrier Classic White Sulphur Springs 
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Diversity Plan 


(Created April 16, 2013) 


The School of Media & Strategic Communications at Oklahoma St. University is 
committed to vigorous pursuit of diversity in its employment, its educational 
programs and its activities. This commitment is based on the school’s dedication 
to educational justice and the promise of each individual as well as the 
adherence to federal and state civil laws and University policies and procedures. 
In November 2012, voters of the state passed State Question 759, a measure 
that eliminated affirmative action programs in the state. The measure deals with 
three areas of government action. These areas are employment, education and 
contracting. 


In these areas, the measure does not allow affirmative action programs. 
Affirmative action programs give preferred treatment based on race, color or 
gender. They also give preferred treatment based on ethnicity or national origin. 
Discrimination on these bases is also not permitted. 


The measure permits affirmative action in three instances. 1. When gender is a 
bonafide qualification, it is allowed. 2. Existing court orders and consent decrees 
that require preferred treatment will continue and can be followed. 3. Affirmative 
action is allowed when needed to keep or obtain federal funds. Though these 
changes may affect how we obtain a diverse population they in no way inhibit the 
school’s commitment to diversity. 


The School sees diversity as an understanding that each individual is unique and 
the recognition and respect of these individual differences. Diversity can manifest 
as dimensions of race, ethnicity, gender, sexual orientation, socio-economic 
status, age, physical abilities, religious and political beliefs as well as other 
ideologies. In addition to these, the School also sees the diversity of professions 
(ie. Journalism, Strategic Communications, Broadcasting, etc.) as important to 
the overall culture of inclusion. 


The commitment to diversity is driven by the school’s curriculum. To ensure 
diversity in its curriculum it is important to recruit both domestic and international 
minority and women faculty members with a commitment to diversity; actively 
recruit minority students and maintaining targeted advising and retention plans; 
integrate contributions of women and minorities to journalism and strategic 


communications in the School's programs; and ensuring that students are 
prepared to work in a multicultural, multiethnic, multi-racial and otherwise diverse 
and global society. 


Our diversity initiative responds to the new media environment that requires our 
students to communicate in a widely diverse, global marketplace. Issues 
involving race, gender, sexual orientation, politics, religion, as well as issues 
involving segmented populations (ie: special needs) are now a mainstay of our 
multi-cultural society and have to be addressed by a knowledgeable workforce. 
These issues therefore has to be addressed in the SMSC curriculum. 


As a public institution, we also seek to mirror the socioeconomic makeup of our 
state. In Oklahoma, 24.2 percent of the population is minority (including those of 
American Indian decent) and just over half (50.5%) of the population is female. At 
Oklahoma State University in the fall of 2011, 29.04 percent of the student body 
was identity as minority and/or international and 48.3 percent of the student body 
was female. Enrollment in the School of Media & Strategic Communications 
(majors and pre-majors) in the fall of 2012 was 25.1 percent minority and 63.1 
percent female. While the numbers are slightly lower than the University’s in 
minority representation and exceed the gender statistics, we realize that our 
efforts to recruit, retain and graduate a fairly equal number of qualified women, 
men and minorities is a goal that must continue. 


The composition of our faculty needs to reflect the realities of our multicultural 
society and an increasingly global marketplace. The school believes minority 
hiring not only be done as a collective whole but that each individual sequence 
contains diverse faculty to better serve our students needs. We have a long 
tradition of hiring women out of both the academic and professional fields as 
professors and educators. In addition we’ve made strong inroads in hiring 
qualified Asian, Gay and Disabled faculty and staff members over the last few 
years. While our diversity standards meet or exceed patterns in the industry and 
in the general population, we nonetheless continue to seek qualified women and 
minority applicants for each position in an effort to maintain our programmatic 
diversity. 


To carry out our commitment to diversity in faculty/staff employment practices, 
student recruitment, educational programs and our departmental culture, the 
OSU School of Media & Strategic Communications has adopted the following 
plans of actions and goals for achievement: 


ACTION PLAN 1. 

In an effort to strengthen diversity, the School must continue to actively 
recruit and provide mentorship for women and minority faculty and staff 
members through personal contacts, networking and contact with 
appropriate academic institutions and academic and professional 
organizations. Work to retain faculty through departmental and campus 


mentorship programs. 

Outcome 1.1: Maintain a minimum goal of 40% women faculty and staff 
members. 

Outcome 1.2: Maintain a minimum of 25% minority faculty and staff members. 
Outcome 1.3: Provide diversity-training seminars on a yearly basis to both 
faculty and staff. 


ACTION PLAN 2. 
Actively recruit minority students to the School. 

Through the OSU Foundation, furnish funds for up to 10 scholarships to 
minorities to attend the various Journalism and Sports media workshops each 
summer. Scholarship students and other members of minority groups, 
economically challenged and at risk prospective students who attend the 
workshop and other on-campus events will be invited to later visit OSU and be 
given consideration for scholarships should they decide to attend the school. 

The School’s faculty members will conduct regular visits to high schools in 
Oklahoma with significant minority enrollments each semester. Minority students 
will be encouraged to attend both OSU and OSU-Tulsa and apply for School 
scholarships. 

Establish an advising plan aimed at minority, economically disadvantaged 
and at-risk student retention. 


Outcome 2.1: We want to see a significant increase in overall student diversity 
in the School, and we pledge to redouble our efforts to attain this goal. 


ACTION PLAN 3. 

Our policy requires reflection of cultural sensitivity and inclusion of the 
contributions of women and minorities throughout the curriculum. We 
pledge to continue academic programs that acknowledge the contributions 
of minorities and women and prepare students to work in a multicultural, 
multi-ethnic, multiracial and otherwise diverse society. 

Outcome 3.1: Syllabi for classes in the School of Media & Strategic 
Communication should include diversity-related material and support this 
standard in one of three ways: 1) as a learning objective, 2) as a statement of 
support for diversity in the classroom or 3) actual course content that covers 
multicultural subjects. 

Outcome 3.2: Offer MC 1143 Media in a Diverse Society on regular basis, every 
semester 

Outcome 3.3: Develop a course in Race, Class and Gender in the Media for 
upper-class and Graduate students. 

Outcome 3.4: Strive to bring in a myriad of guests and visitors to the School that 
promote diversity on many levels. 

Outcome 3.5: Address courses and enrollment at the OSU-Tulsa campus. 


ACTION PLAN 4. Establish and maintain equivalency between genders 


and minority groups in terms of peer support groups in the School. 
Outcome 4.1: This initiative will aim to assist student journalists in joining and 
attending conventions for a minority-centered organization of their choice, 
including: National Association of Black Journalists, Asian American Journalists 
Association, National Association of Hispanic Journalists, Native American 
Journalists Association, National Lesbian and Gay Journalists Association and 
the South Asian Journalists Association. The School will either facilitate their own 
chapters or will serve as a central organization that encourages students to join 
national associations and work to bring national representatives from these 
groups to campus. 


ACTION PLAN 5 Monitor the School’s diversity efforts. 

Outcome 5.1: Establish a diversity committee that will be appointed by the 
Director each year, and will review diversity activities within the School and report 
its findings at least once a year. 


Appendix 4-1 - Job Ads 


Oklahoma State University 

Assistant Professor of Strategic Communication 
Tenure-Track Appointment 

Start date: Fall 2013 


The School of Media and Strategic Communications, Oklahoma State University, invites 
applications for a tenure-track Assistant Professor in its strategic communication degree 
program. The successful candidate must be conversant with aspects of strategic communication 
and should be able to teach a wide variety of courses in the field. The successful candidate will 
be enthusiastic about developing scholarship and teaching in strategic communication and should 
be willing to work in an experimental and developing environment. 


Application requirements 

Candidates should have a Ph.D. degree or ABD in an appropriate field. The applicant should be 
able to teach courses such as strategic communication campaigns, strategic communication 
management, persuasive writing, and introduction to strategic communication in the school’s 
undergraduate program. Knowledge of and experience with the new media environment and 
global outreach is a plus. Candidates with a strong multicultural background or international 
experience are encouraged to apply. An active agenda of scholarly research and publication is a 
requirement. Candidates should have appropriate professional experience. 


About the School of Media and Strategic Communications 

The School of Media and Strategic Communications at Oklahoma State University is nationally 
recognized for producing outstanding practitioners in all mass communication areas and has been 
continuously accredited by the ACEJMC since 1948. It is one of the largest programs in the 
College of Arts & Sciences, the largest college at OSU. 


About Oklahoma State University 

OSU is a research oriented, land grant institution dedicated to the advancement and 
dissemination of knowledge central to a liberal education for all students. It has more than 
22,000 students on three campuses and more than 1,500 faculty members. 


Application procedure 

Review of applications will begin immediately and continue until the position is filled. To be 
fully considered for this position, send a letter of application, curriculum vitae, and the names, 
addresses, and telephone numbers of three references by October 15, 2012 to: 


Dr. Lori McKinnon, Chair 

Strategic Communication Position Search 
School of Media and Strategic Communications 
206 Paul Miller Building 

Oklahoma State University 

Stillwater, OK 74078-4053 


For more information about this position, you are welcome to e-mail the director of the school, 
Dr. Derina Holtzhausen, at derina.holtzhausen@okstate.edu. 





Oklahoma State University is an AA/EEO/E-Verify employer. OSU-Stillwater is a tobacco-free campus. 


INVITATION TO APPLY 


THE SCHOOL OF MEDIA AND STRATEGIC COMMUNICATIONS AT OKLAHOMA STATE UNIVERSITY, 
STILLWATER, INVITES APPLICATIONS FOR THE POSITION OF WELCH-BRIDGEWATER ENDOWED CHAIR 
IN SPORTS MEDIA. 


The position: 


The School of Media and Strategic Communications at Oklahoma State University in Stillwater seeks 
qualified applicants for the Welch-Bridgewater Endowed Chair in Sports Media for fall 2013. Oklahoma 
State University is a Division | university leading the way in offering an undergraduate degree in sports 
media, making this is an exciting opportunity for research and teaching. Salary and benefits are 
competitive. This is a full-time tenured faculty position at the level of associate or full professor. 


Application requirements: 


Applicants should hold a terminal degree. The successful candidate will have an established research 
program and teaching record in sports and the media that will justify an appointment at the level of 
associate or full professor. A secondary research and teaching interest in media law, media ethics, 
sports production, media management or multimedia journalism will be an asset. 


Position responsibilities: 


In addition to research, teaching and service, the chair will take a leadership role in the ongoing 
development of the school’s sports media curriculum. She or he will teach at the undergraduate and 
graduate level and will play an important role in shaping policies and procedures in the School of Media 
and Strategic Communications. The successful candidate also will be the School’s ambassador in 
promoting the Sports Media program. 


About the School of Media and Strategic Communications: 


The School is nationally recognized for producing outstanding practitioners in all mass communication 
areas and has been continuously accredited by the ACEJMC since the 1940s. Our students are actively 
involved in producing sports media content and assisting in live sports productions with all the major 
networks. The School of Media and Strategic Communications is the largest program in the College of 
Arts & Sciences, the largest college at OSU. This is the second endowed chair the School has established 
recently, joining the Peggy Welch Chair in Strategic Communication. 


About Oklahoma State University: 


OSU is a research-oriented, land grant institution dedicated to the advancement and dissemination of 
knowledge central to a liberal education for all students. Additionally, the 22,000-plus students and 
more than 1,500 faculty are known for their loyalty to and enthusiasm for all OSU sports teams, creating 
an environment that is conducive to research and teaching in sport and the media. OSU competes in the 
Big 12 Conference and also offers many opportunities for professional liaison. 


Application procedure: 


Applications received by October 31, 2012, will be fully considered, but applications will be accepted 
until the position is filled. To apply, send a letter of application, a statement of vision for the 
professorship, curriculum vitae and the names, email addresses and telephone numbers of five 
references to: 


Mike Sowell, Chair 

Welch-Bridgewater Chair Search Committee 
School of Media and Strategic Communications 
206 Paul Miller Building 

Oklahoma State University 

Stillwater, OK 74078-4053 


Applications also may be submitted to melissa.powers@okstate.edu. 


If you wish to have more information about this position, please email the chair of the search committee 


at mike.sowell@okstate.edu. 


Oklahoma State University is an AA/EEO/E-Verify employer. OSU-Stillwater is a tobacco-free campus. 


Oklahoma State University 

Assistant Professor of Multimedia Journalism 
Tenure-Track Appointment 

Start date: Fall 2014 


The School of Media & Strategic Communications, Oklahoma State University, invites 
applications for a tenure-track Assistant Professor in its multimedia journalism degree program. 
The successful candidate must be conversant in multimedia journalism and should be able to 
teach a wide variety of courses in this area. The successful candidate will be enthusiastic about 
developing scholarship and teaching in multimedia journalism and will be willing to work in an 
experimental and developing environment. 


Application requirements 

Candidates should have a Ph.D. or another appropriate doctoral degree or ABD in an appropriate 
field. The applicant should be able to teach courses such as multimedia reporting, advanced 
multimedia reporting, advanced writing, public affairs reporting, or multimedia editing and 
should be able to conduct the capstone course in multimedia journalism. The successful 
candidate will have the opportunity to teach at the graduate level in media ethics, process and 
effects, and other graduate level courses in journalism and mass communication. Knowledge of 
and experience with the new media environment is required. Candidates with a strong 
multicultural background or international experience are encouraged to apply. An active agenda 
of scholarly research and publication is a requirement. Candidates should have appropriate 
professional experience. 


About the School of Media & Strategic Communications 

The School of Media & Strategic Communications at Oklahoma State University is nationally 
recognized for producing outstanding practitioners in all mass communication areas and has been 
continuously accredited by the ACEJMC since 1948. It is one of the largest programs in the 
College of Arts & Sciences, the largest college at OSU. 


About Oklahoma State University 

OSU is a research oriented, land grant institution dedicated to the advancement and 
dissemination of knowledge central to a liberal education for all students. It has more than 
22,000 students on three campuses and more than 1,500 faculty members. 


Application procedure 

Review of applications will begin immediately and continue until the position is filled. To be 
fully considered for this position, send a letter of application, curriculum vitae, and the names, 
addresses, and telephone numbers of three references by October 31, 2013 to: 


Chair of the Search Committee 

Assistant Professor in Multimedia Journalism 
School of Media and Strategic Communications 
206 Paul Miller Building 

Oklahoma State University 

Stillwater, OK 74078-4053 


For more information about this position, you are welcome to e-mail the director of the school, 
Dr. Derina Holtzhausen, at derina.holtzhausen@okstate.edu. 

Position is contingent upon available fuunding. 

Oklahoma State University is an AA/EEO/E-Verify employer. OSU-Stillwater is a tobacco-free campus. 





Oklahoma State University 

Associate/Full Professor in Multimedia Journalism 
9-month Tenured Position 

Start date: Fall 2014 


The School of Media & Strategic Communications invites applications for a nine-month tenured 
position at the level of Associate or Full Professor in its multimedia journalism program. 

The successful candidate must be conversant with all aspects of multimedia journalism, 
and should be able to teach a wide variety of courses in this area. Preferably, the candidate will 
have experience of and interest in aspects of entrepreneurial journalism and media ethics and will 
be expected to bring perspectives on diversity into the curriculum. The successful candidate 
should have an established research record and demonstrate an ability to be an effective teacher 
in multimedia journalism and should be willing to work in an experimental and developing 
environment. 

The successful candidate will be encouraged to develop and improve curricula that will 
enhance the multimedia program at both undergraduate and graduate level. Additionally, the 
candidate will be expected to supervise masters’ theses and serve on some departmental, college 
or university committees. 


Application requirements 

A Ph.D. or a doctoral degree in an appropriate field is required. The applicant should already be 
tenured at an established research university. Candidates who have an interest in sport will have 
the opportunity to teach courses in the sports media degree. Knowledge of and experience with 
the new media environment is required. Candidates with an interest in diversity issues, a strong 
multicultural background or international experience are encouraged to apply. An active agenda 
of scholarly research and publication is required. Candidates should have professional 
experience in an appropriate area. 


About the School of Media & Strategic Communications 

The School of Media & Strategic Communications at Oklahoma State University is nationally 
recognized for producing outstanding practitioners in all mass communication areas and has been 
continuously accredited by the ACEJMC since 1948. It is one of the largest programs in the 
College of Arts & Sciences, the largest college at OSU. This appointment is part of a process to 
strengthen the multimedia program and the research and scholarly abilities of the school, which 
will ultimately lead to a new a doctoral program. Faculty members represent a wide variety of 
research interests and provide a nurturing environment for new faculty. 


About Oklahoma State University 

OSU is a research oriented, land grant institution dedicated to the advancement and 
dissemination of knowledge central to a liberal education for all students. It has more than 
22,000 students on three campuses and more than 1,500 faculty members. 


Application procedure 

Review of applications will begin immediately. To be fully considered for this position, send a 
letter of application, curriculum vita, and the names, addresses, and telephone numbers of three 
references by October 31, 2013 to: 


The Search Committee Chair 

Associate/Full Professor in Multimedia Journalism 
School of Media and Strategic Communications 
206 Paul Miller Building 

Oklahoma State University 

Stillwater, OK 74078-4053 


For more information about this position, you are welcome to e-mail the director of the school, 
Dr. Derina Holtzhausen, at derina.holtzhausen@okstate.edu. 





Position is contingent upon available fuunding. 
Oklahoma State University is an AA/EEO/E-Verify employer. OSU-Stillwater is a tobacco-free campus. 


Oklahoma State University 
Assistant Professor in Sports Media 
9-month Tenure-Track Position 
Start date: Fall 2014 


The School of Media & Strategic Communications invites applications for a nine- 
month tenure-track position at the level of Assistant Professor in its Sports Media 
program. 

The successful candidate will have an established research agenda in the 
field of sports media and should be able to teach in at least one, and preferably two, 
of the following areas within the Sports Media major: (1) Multimedia Journalism, (2) 
Sports Production, (3) Sports Information/Public Relations. 

The successful candidate will have the opportunity to teach at the graduate 
level. Online teaching experience will be an asset. The candidate will be expected to 
supervise masters’ theses and serve on some departmental, college or university 
committees. 


Application requirements 

Candidates should have a Ph.D. or a doctoral degree in an appropriate field. ABDs 
will be considered so long as their terminal degree is successfully completed by the 
time of the appointment. Candidates who have an interest in diversity issues and 
have a strong multicultural background or international experience are encouraged 
to apply. An active agenda of scholarly research is required. Candidates should have 
professional experience in an appropriate area, e.g. sports journalism, sports media 
production, sports PR, sports information, sports marketing, or sports social media. 
Knowledge of and experience with the new media environment also is required. 


About the School of Media & Strategic Communications 

The School of Media & Strategic Communications at Oklahoma State University is 
nationally recognized for producing outstanding practitioners in all mass 
communication areas and has been continuously accredited by the ACEJMC since 
1948. It is one of the largest programs in the College of Arts & Sciences, the largest 
college at OSU. This appointment is part of a process to strengthen the sports media 
program and the research and scholarly abilities of the school, which will ultimately 
lead to anew a doctoral program. Faculty members represent a wide variety of 
research interests and provide a nurturing environment for new faculty. 


About the Sports Media program 

The Oklahoma State University undergraduate Sports Media program is the largest 
of its kind in the United States with more than 165 stand-alone majors in its three 
specializations and growing rapidly. The Oklahoma State University chapter of the 
Association for Women in Sports Media (AWSM) won the national organization’s 
first ever Student Chapter of the Year award in 2013, while the Sports Media Club 
has more than 120 members. Successful candidates will have the opportunity to fill 
an advising role for these clubs. Each of the program’s current faculty members 
possesses extensive practitioner experience in sports media and a research focus in 


the field. Students have the opportunity to garner professional and student media 
experience covering or working for major sports organizations, such as Oklahoma 
State athletics, the Oklahoma City Thunder, ESPN, Fox Sports, the state’s major 
television networks, and newspapers and online news media. Most of the state’s 
major sports media outlets have hired Oklahoma State students full-time or as 
interns in recent years. 


About Oklahoma State University 

OSU is a research oriented, land grant institution dedicated to the advancement and 
dissemination of knowledge central to a liberal education for all students. It has 
more than 22,000 students on three campuses and more than 1,500 faculty 
members. 


Application procedure 

Review of applications will begin March 1, 2014. Preference will be given to 
candidates who apply by this date; however, applications will be accepted until the 
search is complete. To apply, send a letter of interest, curriculum vitae, and three 
letters of reference to: 


Chair, Assistant Professor of Sports Media Search Committee 
School of Media and Strategic Communications 

206 Paul Miller Building 

Oklahoma State University 

Stillwater, OK 74078-4053 


Applications also may be submitted as email attachments to 
melissa.powers@okstate.edu. If you wish to learn more information about this 
position, please email the chair of the search committee at 
edward.kian@okstate.edu 








Oklahoma State University is an AA/EEO/E-Verify employer committed to diversity. 
All qualified applicants will receive consideration for employment and will not be 
discriminated against based on race, color, religion, sex, national origin, disability or 
protected veteran status. OSU-Stillwater is a tobacco-free campus. 


= 


School of Media & Strategic Communications 
Oklahoma State University 


Clinical Assistant Professor 


The rapidly growing School of Media & Strategic Communications at Oklahoma 
State University is seeking a strategic communications professional with teaching 
experience to fill a Clinical Assistant Professor position beginning August 2015. 
This position is a continuing non-tenure track appointment, conditional upon 
satisfactory annual performance evaluations by the director of the School. The 
position will teach a slightly larger number of courses than tenure track faculty, 
provide service and committee responsibilities, but will not have a scholarly or 
creative expectation. Primary teaching emphasis will be in Persuasive Writing 
and Media Style & Structure. These courses combine class lectures and labs 
while introducing students to the fundamental writing styles and objectives 
required to convey information in different media, as well as the language of 
persuasive communication and the techniques of persuasive message strategy. 
Relevant professional experience is required. Master’s degree is required with 
emphasis in strategic communications or closely related field. 


Submit application letter, curriculum vitae, transcripts and names, addresses and 
telephone numbers of three references to Chair, Clinical Assistant Professor 
Search Committee, School of Media & Strategic Communications, Oklahoma 
State University, 206 Paul Miller Bldg., Stillwater, OK 74074-4053. Review of 
applicants will begin March 1, 2015 and continue until the position is filled. 
Position is contingent upon available funding. 


Oklahoma State University is an Affirmative Action/Equal Opportunity / E- 
verify employer committed to diversity and all qualified applicants will receive 
consideration for employment and will not be discriminated against based on 
race, color, religion, sex, sexual orientation, gender identity, national origin, 
disability or protected veteran status. OSU is a VEVRAA Federal Contractor and 
desires priority referrals of protected veterans for its openings. OSU-Stillwater is 
a tobacco-free campus. 


= 


School of Media & Strategic Communications 
Oklahoma State University 


Clinical Assistant Professor 


The rapidly growing School of Media & Strategic Communications at Oklahoma 
State University is seeking a strategic communications professional with teaching 
experience to fill a Clinical Assistant Professor position beginning August 2016. 
This position is a continuing non-tenure track appointment, conditional upon 
satisfactory annual performance evaluations by the director of the School. The 
position will teach a slightly larger number of courses than tenure track faculty, 
provide service and committee responsibilities, but will not have a scholarly or 
creative expectation. Primary teaching emphasis will be in Persuasive Writing 
and Media Style & Structure. These courses combine class lectures and labs 
while introducing students to the fundamental writing styles and objectives 
required to convey information in different media, as well as the language of 
persuasive communication and the techniques of persuasive message strategy. 
Relevant professional experience is required. Master’s degree is required with 
emphasis in strategic communications or closely related field. 


Submit application letter, curriculum vitae, transcripts and names, addresses and 
telephone numbers of three references to Melissa Coldiron, School of Media & 
Strategic Communications, Oklahoma State University, 206 Paul Miller Bldg., 
Stillwater, OK 74078-4053. Review of applicants will begin immediately and 
continue until the position is filled. For full consideration, applications should 
reach the school by April 1, 2016. Position is contingent upon available funding. 


Oklahoma State University is an Affirmative Action/Equal Opportunity / E- 
verify employer committed to diversity and all qualified applicants will receive 
consideration for employment and will not be discriminated against based on 
race, color, religion, sex, sexual orientation, gender identity, national origin, 
disability or protected veteran status. OSU is a VEVRAA Federal Contractor and 
desires priority referrals of protected veterans for its openings. OSU-Stillwater is 
a tobacco-free campus. 


E 


School of Media and Strategic Communications 
Oklahoma State University 


The School of Media and Strategic Communications at Oklahoma State 
University seeks a Visiting Assistant Professor to teach four sections total per 
semester to include SC 3753, Graphic Design for Strategic Communications and 
SC 3603, Copywriting and Creative Strategy during the Fall 2016/Spring 2017 
academic year. The successful candidate will be able to teach these courses 
based on significant professional experience. These courses combine class 
lectures and labs while introducing students to graphic design focusing on 
elements used in strategic communication to include both traditional media and 
new media, along with emphasis on developing creative strategy in the context 
of an advertising campaign with in-depth skills development in advertising 
copywriting across all media and formats. Minimum qualifications for this 
position include a professional background in graphic design, plus teaching 
experience. Master’s degree is required with emphasis in strategic 
communications or closely related field. 


Submit letter of interest, resume and three letters of reference to Melissa 
Coldiron, School of Media and Strategic Communications, Oklahoma State 
University, 206 Paul Miller Bldg., Stillwater, OK 74074-4053. Review of 
applicants will begin May 1, 2016 and will continue until the position is filled. 


Oklahoma State University is an Affirmative Action / Equal Opportunity / E- 
verify employer committed to diversity and all qualified applicants will receive 
consideration for employment and will not be discriminated against based on 
race, color, religion, sex, sexual orientation, gender identity, national origin, 
disability or protected veteran status. OSU is a VEVRAA Federal Contractor and 
desires priority referrals of protected veterans for its openings. OSU-Stillwater is 
a tobacco-free campus. 


& 


School of Media and Strategic Communications 
Oklahoma State University 


The School of Media and Strategic Communications at Oklahoma State 
University seeks a Lecturer to teach various courses within our strategic 
communications sequence. The qualified candidate must be able to teach SC 
3953, Research Methods for Strategic Communications, and SC 3603, 
Copywriting and Creative Strategy during the 2017-2018 academic year. These 
courses combine class lectures and labs while introducing students to in-depth 
skills development in advertising copywriting across all media formats, as well 
as providing an overview of strategic communication research, with emphasis on 
its application to the development and evaluation of the strategic communication 
message. Minimum qualifications for this position include a professional 
background in strategic communication, plus teaching experience. Master’s 
degree is required with emphasis in strategic communication or closely related 
field. 


Submit letter of interest, resume and names, addresses and telephone numbers of 
three references to Melissa Coldiron, School of Media and Strategic 
Communications, Oklahoma State University, 206 Paul Miller Bldg., Stillwater, 
OK 74074-4053. Review of applicants will begin April 15, 2017 and will continue 
until the position is filled. 


Oklahoma State University is an Affirmative Action/Equal Opportunity / E- 
verify employer committed to diversity and all qualified applicants will receive 
consideration for employment and will not be discriminated against based on 
age, race, color, religion, sex, sexual orientation, genetic information, gender 
identity, national origin, disability, protected veteran status, or other protected 
category. OSU is a VEVRAA Federal Contractor and desires priority referrals of 
protected veterans for its openings. OSU will not discharge or in any other 
manner discriminate against employees or applicants because they have inquired 
about, discussed, or disclosed their own pay or the pay of another employee or 
applicant. However, employees who have access to the compensation 
information of other employees or applicants as a part of their essential job 
functions cannot disclose the pay of other employees or applicants to individuals 
who do not otherwise have access to compensation information, unless the 
disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of 
an investigation, proceeding, hearing, or action, including an investigation 
conducted by the employer, or (c) consistent with the contractor’s legal duty to 
furnish information. 


Oklahoma State University 
Assistant Professor 
Tenure-Track Appointment 
Start date: August 2017 


The School of Media & Strategic Communications at Oklahoma State University invites 
applications for a tenure-track Assistant Professor in one of our three degree programs (strategic 
communications, multimedia journalism and sports media). The successful candidate must be 
able to teach a wide variety of courses in one of the three areas. The successful candidate will 
also be enthusiastic about developing and continuing an active research agenda. 


Application requirements 

A terminal degree at the time of employment is required. The applicant should be able to teach 
intermediate courses in their area of specialty and should be able to lead the capstone course. 
Qualified candidates will have the opportunity to teach at the graduate level. Knowledge of, and 
experience with, the new media environment is required. Candidates with a strong multicultural 
background or international experience are encouraged to apply. An active agenda of scholarly 
research and publication is preferred. Candidates should have appropriate professional industry 
experience. 


About the School of Media & Strategic Communications 

The School of Media & Strategic Communications at Oklahoma State University is nationally 
recognized for producing outstanding practitioners in all mass communication areas and has been 
continuously accredited by the ACEJMC since 1948. It is one of the largest programs in the 
College of Arts & Sciences, the largest college at OSU. 


About Oklahoma State University 

OSU is a research-oriented, land grant institution dedicated to the advancement and 
dissemination of knowledge central to a liberal education for all students. It has more than 
22,000 students on four campuses and more than 1,500 faculty members. 


Application procedure 

Review of applications will begin immediately and continue until the position is filled. To be 
fully considered for this position, send a letter of application, curriculum vitae, and the names, 
addresses, and telephone numbers of three references by November 21, 2016 to: 


Melissa Coldiron, Administrative Associate 
School of Media and Strategic Communications 
206 Paul Miller Building 

Oklahoma State University 

Stillwater, OK 74078-4053 


For more information about this position, you are welcome to e-mail the director of the school, 
Craig Freeman, at freemanc@okstate.edu. 





Position is contingent upon available funding. 

Oklahoma State University is an Affirmative Action/Equal Opportunity/E-verify employer 
committed to diversity and all qualified applicants will receive consideration for employment 
and will not be discriminated against based on age, race, color, religion, sex, sexual orientation, 
genetic information, gender identity, national origin, disability, protected veteran status, or other 
protected category. OSU is a VEVRAA Federal Contractor and desires priority referrals of 
protected veterans for its openings. OSU will not discharge or in any other manner discriminate 


against employees or applicants because they have inquired about, discussed, or disclosed their 
own pay or the pay of another employee or applicant. However, employees who have access to 
the compensation information of other employees or applicants as a part of their essential job 
functions cannot disclose the pay of other employees or applicants to individuals who do not 
otherwise have access to compensation information, unless the disclosure is (a) in response to a 
formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, 
including an investigation conducted by the employer, or (c) consistent with the contractor’s 
legal duty to furnish information. 
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School of Media & Strategic Communications 
Oklahoma State University 


Assistant Professor of Professional Practice 


The rapidly growing School of Media & Strategic Communications at Oklahoma 
State University is seeking a strategic communications professional with teaching 
experience to fill an Assistant Professor of Professional Practice position 
beginning August 2019. This position is a continuing non-tenure track 
appointment, conditional upon satisfactory annual performance evaluations by 
the director of the School. The position will teach a slightly larger number of 
courses than tenure track faculty, provide service and committee responsibilities, 
but will not have a scholarly or creative expectation. Primary teaching emphasis 
will be in Persuasive Writing and Media Style & Structure. These courses 
combine class lectures and labs while introducing students to the fundamental 
writing styles and objectives required to convey information in different media, 
as well as the language of persuasive communication and the techniques of 
persuasive message strategy. Relevant professional experience is required. 
Master’s degree is required with emphasis in strategic communications or closely 
related field. 


Submit application letter, curriculum vitae, transcripts and names, addresses and 
telephone numbers of three references to Melissa Coldiron, Assistant Professor of 
Professional Practice Search Committee, School of Media & Strategic 
Communications, Oklahoma State University, 206 Paul Miller Bldg., Stillwater, 
OK 74074-4053. Review of applicants will begin March 1, 2019 and continue 
until the position is filled. Position is contingent upon available funding. 


Oklahoma State University, as an equal opportunity employer, complies with all 
applicable federal and state laws regarding non-discrimination and affirmative 
action. Oklahoma State University is committed to a policy of equal opportunity 
for all individuals and does not discriminate based on race, religion, age, sex, 
color, national origin, marital status, sexual orientation, gender 

identity /expression, disability, or veteran status with regard to employment, 
educational programs and activities, and/or admissions. For more information, 


visit https: / / /eeo.okstate.edu. 


Appendix 4-2 - SMSC Promotion & Tenure 
Document 


SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 
SMSC 


Policy on Reappointment, Promotion, Tenure 


and Cumulative Review 


OSU 

OSU 

OSU 

OSU 

OSU 

OSU 

OSU 

OSU 

OSU 

OSU 

OSU 

School of Media & Strategic Communications 
Oklahoma State University 

Stillwater, Oklahoma 

Approved by the Faculty - May 1992 

Revised 5/97, 11/98, 2/02, 2/13, 10/13, 8/15, 1/16, 4/16 








Criteria, Standards and Procedures 
for Appointment, Evaluation, Tenure, Promotion and Cumulative Review 


School of Media & Strategic Communications 
Oklahoma State University 


I. GOALS AND OBJECTIVES 
II. COMPOSITION AND OPERATION OF THE PERSONNEL COMMITTEE 
A. General Statement of the Duties of the Personnel Committee 
1. Duties Regarding Reappointment, Tenure, Promotion and Cumulative Review 
2. Procedures Regarding Reappointment, Tenure, Promotion and Cumulative 
Review 
Composition of the Personnel Committee 
Officers of the Committee 


. Meetings of the Committee 
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Confidentiality of Deliberations 
F. Notification of the Candidate 
Il. PROCEDURES FOR ANNUAL EVALUATIONS 
A. Initial Appointment 
1. Traditional Academic Appointment — Tenure Track 
2. Professional Appointment — Tenure Track 
3. Non-Tenure Track Appointments 
B. Annual Merit Evaluation 
1. Annual Review Materials 
2. Conduct of Evaluations 
3. Evaluation Criteria 
IV. PERFORMANCE CRITERIA 
A. Teaching 
1. Classroom/Lab Teaching 
2. Syllabi and Instructional Materials 
3. Measuring Student Achievement 


4. Student Evaluations of Teaching 


5. Non-Class Instructional and Curriculum-Related Activity 
6. Advising 
B. Research and Creative Work 
1. The Nature of Research and Creative Work for Our Discipline 
2. Criteria for Evaluation of Research and Creative Endeavors 
C. Service 
1. Service to the Profession 
2. Service to the Academic Discipline 
3. Service to the University 
4. Service to the Public 
5. Administrative Duties 
V. PROCEDURES FOR REAPPOINTMENT, PROMOTION, TENURE AND CUMULATIVE 
REVIEW 
A. Tenure, Reappointment and Cumulative Review 
1. Standards for Tenure 
a. Teaching 
b. Research and Creative Work 
c. Service 
2. Reappointment Procedures 
3. Tenure Procedures 
4. External Peer Review 
5. Cumulative Review Procedures 
B. Promotion in Rank 
1. Standards for Promotion to Associate Professor 
2. Standards for Promotion to Full Professor 


3. Standards for Promotion for Clinical Faculty 


I. GOALS AND OBJECTIVES 


The professorate is more than a singular pursuit. It requires a mosaic of contributions through 


quality teaching, meaningful research/creative endeavors, and dedicated service. 


The School of Media & Strategic Communications (SMSC) serves a variety of constituencies — 
students who need competent instruction, media organizations that benefit from public service, a 
university community that recognizes the centrality of communications, the academy that benefits 
from meaningful research and a society-at-large that becomes better informed through the creation 


and application of knowledge in the discipline. 


These responsibilities require a faculty with an appropriate balance of professional experience, 
academic credentials, teaching excellence and a commitment to extend knowledge beyond the 


campus through scholarly publication, creative endeavors and public service. 


A faculty must match a program’s goals. As an academic unit with a strong professional 
component at the undergraduate level, the School of Media & Strategic Communications seeks to 


impart to students: 


1. An understanding of the relevant constitutional freedoms, legal issues and ethical 
principles in mass communications. 

An understanding of the relevance of human diversity in mass communications. 

An understanding of the history and social role of mass communications. 

The ability for critical, creative and individual thinking. 

An understanding of the relevant theories and concepts of mass communications. 

An understanding of the methods and techniques of research and information gathering. 


Appropriate writing, editing and production techniques in mass communications. 
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An understanding of relevant planning and management methods in mass communications. 


Beyond the classroom, the School expects its faculty members to contribute in each of these areas: 


e Scholarly research or creative endeavors or both that extend and apply knowledge. 

e Service to the university, to the profession and to the public, in keeping with the 
university’s land-grant heritage. 

e Advancing the reputation and impact of Oklahoma State University in the state, the 


nation and the world. 


The School seeks to appoint, grant tenure and promote those candidates whose quality, quantity 


and diversity of talents best serve these goals. 


This document provides the criteria, standards and procedures for evaluation of faculty 
performance in achieving this mission in instruction, scholarship and service. It is a document 
consistent with the policies and procedures for appointment, evaluation, tenure and promotion and 


cumulative review established in the OSU Faculty Handbook. 


II. COMPOSITION AND OPERATION OF THE PERSONNEL COMMITTEE 


A. General Statement of the Duties of the Personnel Committee 





The duties of the Personnel Committee are to advise on appointment, reappointment, tenure, 
promotion and cumulative review. The committee also advises and assists the School Director in 
appointing ad hoc search committees of faculty members. The Personnel Committee also will 
assist the Director in developing a suitable description for the position of the search. A member 
of the Personnel Committee shall serve on each search committee. Each search committee shall 
elect a tenured faculty member as its chair. Members of the Personnel Committee are eligible to 


serve on ad hoc committees. 
To assist with and facilitate faculty development, the Personnel Committee will meet with all 
untenured faculty members early in the fall semester to ensure proper mentoring. The committee 


will advise the Director in providing a tenured faculty mentor for each untenured faculty member. 


1. Duties Regarding Reappointment, Tenure, Promotion and Cumulative Review 





The Personnel Committee will review and process requests on reappointment, 
tenure, promotion and cumulative review when the individual faculty member, a 
member of the Personnel Committee or the School’s Director presents them. It will 


act on matters according to established School, College and University policies. 


2. Procedures Regarding Reappointment, Tenure, Promotion and Cumulative 





Review 


In reappointment, tenure, promotion and cumulative review deliberations, all 
members of the Personnel Committee must be present. All tenured faculty 
members are eligible and encouraged to participate and vote on such personnel 
actions. Any minority opinions must be included in the committee’s 


recommendation letter if there is a split vote. 


B. Composition of the Personnel Committee 





The Personnel Committee of the School of Media & Strategic Communications will be composed 
of at least three but no more than five tenured faculty members on a 100 percent FTE appointment 
in the School. Faculty members who are undergoing cumulative review must recuse themselves 
from consideration of their own cumulative review but will still retain eligibility as members of 
the committee. Committee members are elected to a one-year term at the beginning of each 
academic year. All faculty members with a 100 percent FTE appointment in the School are eligible 
to participate in the election of the committee members. 

If a unit cannot complete its personnel committee with voting faculty of appropriate rank from 
within the unit, members of the committee in consultation with the unit administrator will solicit 
faculty from similar departments or disciplines at the University to assist the personnel committee 


with the review and recommendation. 


C. Officers of the Committee 





Members of the Personnel Committee will elect a chair at the first meeting each year. 


D. Meetings of the Committee 





The Personnel Committee will meet upon call by the committee chair, by the School Director or 
by a signed petition from a majority of all faculty members with a 100 percent FTE appointment 
in the School. 


Robert’s Rules of Order will be the standard for committee procedures. 


E. Confidentiality of Deliberations 





All deliberations of the Personnel Committee regarding reappointment, tenure, promotion and 


cumulative review will be confidential. 


F. Notification of the Candidate 





The School’s Director will notify the candidate when he or she is to be considered for 
reappointment, tenure, promotion or cumulative review and the candidate will be invited to submit 
evidence supporting the candidacy. The candidate will have separate meetings early in the fall 
semester with the School’s director to discuss policies for their personnel action. The director will 
provide the candidate and the Personnel Committee with a schedule of when the School’s materials 
are due. The faculty member and the School Director share responsibility for preparing the 
documentation file that is forwarded to the Dean’s Office and that is described elsewhere in this 


document. 


When the Personnel Committee’s recommendation is complete, it will inform the candidate of the 
recommendation and deliver to the candidate a copy of the original letter concerning the action as 
well as a copy to the Director. The original recommendation letter will be added to the 


documentation file for review by the School Director. 


Ill. PROCEDURES FOR ANNUAL EVALUATIONS 


The criteria for assessing faculty performance described below are used to judge the level of 
quality in teaching, research/creative endeavors and service for each of the evaluation procedures 
conducted in the School. These include initial appointment to faculty positions, annual review of 
all faculty members for merit salary increases, reappointment of both tenure-track and annually 
appointed faculty, the tenure review process (which includes reappointment and the review for 
tenure) cumulative review and promotion in rank. A description of the application of these criteria 


and standards for each procedure follows. 


With the exception of the initial faculty appointment, the procedures described below rely on 
documentary evidence for faculty performance. These materials are submitted annually by all 
faculty members. Use of the “Appraisal and Development” (A & D) form provides a standardized 
reporting mechanism. All faculty members should use the form and attach other supporting 


materials to document their work in teaching, research/creative endeavors and service. 


A. Initial Appointment 


Candidates are recommended for initial appointment only after the School’s faculty has assessed 
the candidate’s level and quality of academic preparation, professional experience and potential 


contributions as a faculty member. 


During the search for a new faculty member, the expected credentials must be clearly stated in the 
job description, which must be circulated nationally. The letter of offer will clearly state the 


performance expectations of the faculty member in terms of eligibility for tenure and promotion. 


In the case of a tenure-track appointment the faculty member customarily goes through a mid- 
tenure review as specified by the College of Arts & Sciences. Appointment with tenure is possible 


at the level of associate professor or professor. 


1. Traditional Academic Appointment — Tenure Track 


A doctoral degree is the usual prerequisite for appointment to one of the academic ranks in the 
School. An appointment at the rank of lecturer may be made in anticipation of obtaining the 
terminal degree. When such an appointment is made, it will be with the written agreement that the 


doctorate must be obtained within a specified time to qualify for retention. 


2. Professional Appointment — Tenure Track 


When a candidate has such a high profile in her/his profession that the appointment will bring 
recognition and add to the School’s national reputation and in such cases that an appointment at 
the level of a clinical professor is not appropriate, a candidate without a terminal degree shall be 
considered for a tenure track appointment. Although the School recognizes that accomplishments 
or experience other than the terminal degree may qualify a candidate for a tenure track 
appointment, these candidates will be held to the same standards and level of performance as their 
tenure-track peers in terms of teaching, research/creative activity and service and have the same 


requirements for promotion and tenure. 


3. Non-Tenure Track Appointments 


As noted in OSU Policy and Procedures 2-0903, “Clinical faculty appointments are renewable 
term, nontenure track appointments at the rank of Clinical Instructor, Clinical Assistant Professor, 
Clinical Associate Professor and Clinical Professor.” Clinical appointments are intended to offer 
a career path to individuals who have professional experience and qualifications, in contrast to the 


traditional teaching, research and service experience and qualifications of tenure-track faculty. 


Clinical Instructors, Clinical Assistant Professors, and Clinical Associate Professors will be 


eligible to seek promotion after appropriate time of service in rank. 


B. Annual Merit Evaluation 


The School uses the calendar year as the period for annual faculty evaluations. The following 


section outlines the procedures and requirements for annual evaluation of all faculty members. 


1. Annual Review Materials 


Each faculty member shall submit an annual summary of activities using the Appraisal and 
Development Form, along with supporting materials, for the preceding calendar year only. The 


faculty member will also provide an updated vita. 


Materials to be used in assessing teaching performance shall be in accord with the SMSC 
evaluation of teaching policy. For research/creative work, the faculty member shall submit copies 
or evidence of any work published or produced during the calendar year. For work in progress, the 
faculty member shall submit materials to demonstrate the work that has been done to date, along 
with an estimate of the eventual outcome(s) of the project. For service, the faculty member should 
provide supporting materials beyond the listing of service activities, especially for external and 
professional service or activity as an officer of an academic or professional organization. 


Supporting materials can be in the form of announcements, meeting documents, websites or letters. 


2. Conduct of Evaluations 


The Director shall prepare a written annual evaluation for each faculty member at least two weeks 


before the university deadline for faculty evaluations. 


The Director will assess each faculty member’s performance in each area of work for which time 
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was allocated as “outstanding,” “excellent,” “good,” “minimal” or “inadequate.” The Director will 
also make an overall assessment of each faculty member’s performance, again using one of the 


five assessment categories listed above. 
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Each faculty member will have the opportunity to review the written evaluation before it is 
submitted to the next administrative level. Faculty members will schedule a meeting to discuss the 
evaluation with the director before the evaluation is submitted to the next administrative level. 
Each faculty member must sign a statement acknowledging the opportunity to review the 
evaluation with the director. If there is a disagreement between the faculty member and the 
Director over the appraisal statement that is not resolved during the meeting, both the faculty 
member and the Director should consult the OSU Policies and Procedures 2-0112 par. 2.07 to learn 


their options. 


3. Evaluation Criteria 


The following assessment categories are used to evaluate faculty. Each category is defined as 


stated below and in Section 4 of this document. 


Category A: Outstanding (Performance exceeds all expectations associated with the faculty 
position. The faculty member’s work brings honor and/or recognition to the School’s 


reputation at the state, regional, national or international level.) 


e In research, the faculty member has produced research or creative activity of the highest 
level, which has brought honor and/or recognition to the state, regional, national or 
international reputation of the School; 

e In teaching, the faculty member consistently provides outstanding instruction (including 
any awards associated with classroom performance and/or pedagogy); 

e The faculty member has a record of outstanding service that has brought honor and/or 
recognition to the department and/or university and/or the profession at the state, regional, 


national or international level. 
Category B: Excellent (Performance creates original and/or significant contributions beyond 


expectations associated with the faculty position. The faculty member’s work enhances to 


School’s reputation at the state, regional, national or international level.) 


11 


In research, the faculty member has an excellent record of scholarly or creative activity 
that has contributed to the state, regional, national or international reputation of the School; 
In teaching, the faculty member consistently provides excellent instruction; 

The faculty member has an excellent record of service to the department and/or university 


and/or the profession at the state, regional, national or international level. 


Category C: Good (Performance more than meets expectations associated with the faculty 


position. The faculty member’s work benefits the School’s reputation at the state, regional, 


national or international level). 


In research, the faculty member has a good record of scholarly or creative activity that has 
contributed to the state, regional, national or international reputation of the School; 

in teaching, the faculty member consistently provides good instruction; 

the faculty member has a good record of service to the department and/or university and/or 


the profession at the state, regional, national or international level. 


Category D: Minimal (Performance meets only minimum expectations associated with the 


faculty position. The faculty member’s work has minimal impact on the School’s reputation 


at the state, regional, national or international level. 


In research, the faculty member maintains minimum record of scholarly or creative 
activity; 

In teaching, the faculty member maintains acceptable record of instruction; 

The faculty member maintains minimum record of service to the department and/or 


university and/or the profession at the state, regional, national or international level. 


Category E: Inadequate (Performance fails to meet minimum expectations associated with 


the faculty position. The faculty member’s work diminishes the School’s reputation at the 


state, regional, national or international level. 
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e In research, the faculty member fails to maintain minimum record of scholarly or creative 
activity; 

e In teaching, the faculty member fails to maintain minimum acceptable record of 
instruction; 

e The faculty member fails to maintain minimum record of service to the department and/or 


university and/or the profession at the state, regional, national or international level. 


IV. PERFORMANCE CRITERIA 


The evaluation of faculty is based on the quality of performance in teaching, research and/or 
creative endeavors and service. Faculty provide evidence for this performance on an annual basis 
by compiling materials that establish the range, quality and context for the work they have 


accomplished in each of these areas. 


The following guidelines and criteria are provided to suggest the standards against which a faculty 


member’s performance will be assessed in each of the three areas of faculty responsibility. 


A. Teaching 


Teaching encompasses a range of faculty activity, including planning and teaching courses, 


creation of courses, student advising and supervision of graduate students. 


Most of the information available for making an assessment of the success and quality of teaching 
is subjective rather than objective. As a result, the School uses a variety of criteria for the 


evaluation of teaching. 


Each faculty member, as part of the reappointment, tenure and promotion or cumulative review 
process, shall prepare a compilation of materials on the courses taught and other teaching activities 
accomplished since their initial appointment or most recent promotion. The School expects the 


following types of information as part of this “portfolio” approach. 
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e Evidence of effectiveness in classes and/or labs. 

e Appropriate preparation of syllabi and instructional material. 

e Evidence of the appropriateness of methods for measuring student achievement 

e Reports of student evaluations. 

e A self-report on non-classroom instructional and curriculum-related activity. 

e Evidence of performance in student advising such as on a thesis committee or 


independent study supervisor. 


1. Classroom/Lab Teaching 


Each faculty member will provide a summary report on activities associated with assigned class 
sections during the year. Providing context is the primary purpose of the summary report. It should 
begin with a listing of each course, of the enrollment in the course and of the type of course (lecture, 
lab, etc.), followed by a statement on how often and how many times the faculty member has 
taught each course. In the rest of the report, the faculty member may address course content and 
strategies, efforts to revise or introduce innovations into courses, collaboration with other faculty 
members on course development, development of new courses, and preparation for teaching an 
existing course for the first time. The summary report must also address how the faculty member 


gets feedback from students about the instruction in courses. 

The summary report should also include the faculty member’s analysis of any special 
circumstances that may have an effect on the quality of instruction. Such circumstances can include 
factors such as class size, whether a class is required or is elective, whether a class is graduate 
level and the stringency of academic or professional standards used in a class. 


2. Syllabi and Instructional Materials 


Faculty members shall provide copies of their syllabi. Examples of major instructional materials 


also may be provided. 


SMSC course syllabi must include: 
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e Statement of course purpose, goals, objectives and student learning outcomes; 
e Assigned textbook/readings and course readings list; 

e Statement of student grading and assessment standards and procedures; 

e Schedule of class dates and topics; 

e Listing of assignments, graded projects and examinations; 


e Faculty office hours, address, phone number and email. 


Faculty members are to submit copies of syllabi to the Director’s office by the beginning of classes 
for each semester, summer session or intersession. If modifications are made to a syllabus, the 


revised version should be filed with the School with the date of revision marked. 


3. Measuring Student Achievement 


Appraisal of the appropriateness of methods for measuring student achievement calls for faculty 
members to report on how the courses they teach relate to the Eight Learning Outcomes for the 
School, which are tied to the AECJMC accreditation standards. In general, the faculty member 
should explicitly state the academic and/or professional standards that are being applied and how 
measuring student achievement promotes the meeting of those standards. This portion of the 
teaching portfolio will also provide information relevant to assessment of student outcomes for the 


school as a whole. 


4. Student Evaluations of Teaching 


Statistical forms students complete for evaluation of the effectiveness of teaching are a useful but 
subsidiary part of the annual evaluation of the teaching performance of faculty members in the 
School. Their usefulness is mainly in helping to assess teaching over an extended period, however, 


rather than a semester at a time. The School’s course schedule each semester includes many types 
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of classes such as large undergraduate lectures, small professional lab classes, large required core 
curriculum courses, small undergraduate academic classes and small graduate classes. Comparison 
of results in SMSC classes to classes throughout the university is untrustworthy because of the 
number of low-enrollment sections in the school and because of the essential professional 


standards in required classes. 


Students evaluate faculty members using the OSU course evaluation form for each course section 
they teach. Faculty members must be evaluated using these forms each semester for each course 
they teach. All faculty members are urged to get feedback by encouraging students’ written 
comments and by providing supplementary questions beyond those on the standard evaluation 


forms. Administration of student evaluation forms is to occur without the instructor present. 


Faculty members are responsible for providing copies of the summary forms for evaluations and 


of any written student comments. 

5. Non-Class Instructional and Curriculum-Related Activity 
Faculty members who arrange, direct and supervise students in a media practicum section, 
independent study, internships and graduate theses should submit information about those 
activities. 
Advising of graduate students, service as the chair or a member of a graduate student’s committee 
and advisory work with graduate students on research or other projects should be addressed in this 
subsection. 
Training and/or supervision of graduate teaching assistants should be addressed in this subsection. 
Other types of activities that should be addressed in this part of the portfolio include voluntary 


teaching in other faculty members’ classes, work with groups of faculty members on course 


development and revision, and mentoring of faculty members in their teaching. 
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Evidence of activity outside of the School in pedagogical or academic work should also be 


submitted in this part of the portfolio. 


6. Advising 


Advising of thesis, honors projects or independent study is considered part of teaching for purposes 
of the annual evaluation. Efforts in career and professional advising should be addressed here as 
well. Those who engage in such advising should provide any materials or documentation that will 


help in the performance review. 


B. Research/Creative Work 


Our faculty and students seek to contribute to a greater understanding of the power and impact of 
mass communications and work toward their improvement as a mechanism for ensuring the 
freedoms of a democratic society. Faculty in the SMSC are expected to make original intellectual 
or artistic contributions through scholarship, either as original research, creative work in 
journalism and mass communications, interdisciplinary scholarly work, guiding graduate students' 


research or the use of specialized knowledge to address significant social or professional problems. 


Communication research is not a narrow, or even easily defined, endeavor. Our discipline 
encompasses scholars in law and the medical sciences, as well as all of the social sciences. 
Research and creative endeavors in our discipline routinely appear not only in mass 
communication outlets but also in professional and scholarly outlets in related fields, such as, 
business, law, medical, health, history, psychology, art, education and in other social science and 


natural scientific venues. 


Because our discipline has a strong professional orientation, scholarship in our discipline can also 
constitute creative endeavors in any of the mass media. Because assessments of quality are 
important in the academy, we believe all professional and creative work should be externally 
evaluated, in whatever manner is appropriate to the work, so that colleagues who are not in our 


discipline can independently determine the quality of professional or creative activity for purposes 
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of annual review, tenure and promotion. 


1. The Nature of Research and Creative Work for Our Discipline 


Evaluation of faculty performance in this domain is focused on (but is not necessarily limited to) 


these items listed in alphabetical order: 


e Articles in academic journals (including on-line journals) 
e Articles in law journals or law reviews (including on-line journals) 
e Academic Conference paper presentations 
e Book or Article reviews 

e Books 

e Bulletins 

e Chapters in books or articles in anthologies 
e Citations of one’s work 

e Conference or meeting proceedings 

e Final reports from grant activities 

e Grant applications and extramural funding 
e In-house publications 

e Magazine articles 

e Miscellaneous printed reports 

e Multimedia works 

e Newspaper articles 

e Online works 

e Photographic works and exhibitions 

e Radio/TV programs written 

e Radio/TV programs produced 

e Research or technical reports 

e Trade publications 


e Works in progress 
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2. Criteria for Evaluation of Research and Creative Endeavors 


Keeping in mind the difficulty inherent in evaluating research and creative endeavors by merely 
counting the number of published works, evaluation of performance in this area must by necessity 
take into account the quality and significance of the work. Peer review is the standard for 
determining quality, which will vary according to the kind of publication, report or other format. 


Impact and significance of the work are also important indicators of quality. 


Criteria appropriate for evaluating the quality of research and creative endeavors include such 
dimensions as the quality of journals, indicated by rejection rates and other measures of prestige. 
The nature of authorship (either first or sole authorship), or the nature of collaboration are also 
considerations. The candidate can also provide evidence of the quality of articles by citation, 
among other indices of an article’s impact on the field. Sole and first authorship are deemed more 
meritorious than papers published as second or third (etc.) author, though evidence of collaborative 
skills is also important. Another indication of quality is a manuscript invited for revision and 


resubmission. 

C. Service 
Every faculty member is expected to make significant contributions to the School’s wide range of 
constituencies. The service component involves contributions to the profession, the academic 
discipline, the university and the public. 
When determining the faculty member’s contribution, the focus is on the leadership level and the 
quality of involvement. Service cannot be the major grounds upon which tenure or promotion are 


based. 


Faculty activities, as a general rule, are considered to be valid service to the profession, discipline 


or university, only when they are performed using competencies relevant to the faculty member’s 
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role or area of specialization or both at the university. These categories are not intended to be 


hierarchical. 


1. Service to the Profession 


This includes assisting and sharing knowledge with a communication organization or audience. 


Criteria in this category are focused on (but not necessarily limited to) these items: 


e Paid freelance work for a communication organization. 

e Paid consulting work for a communication organization. 

e Unpaid freelance or consulting work for a communication organization, other 
schools, government, etc. 

e Representing the profession in public forums (e.g., expert testimony). 

e Cultivating productive relations with outside constituents (newspapers, radio 
stations, advertising agencies, etc.). 

e Professional Conference Presentations 


e Professional Blog Posts 


2. Service to the Academic Discipline 


This includes taking an active role in scholarly associations and academic publications. Criteria in 


this category are focused on (but not necessarily limited to) these items: 


e Holding an office, serving as a committee chair or other administrative 
responsibilities in an appropriate scholarly and professional organization. 

e Planning and participating in programs, seminars and workshops that contribute to 
serving the School’s professional and academic constituencies. 

e Serving as journal editor or editorial board member for a professional 
organization’s publication. 

e Serving as a peer reviewer of articles, manuscripts submitted to refereed journals, 


book publishers. 
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e Serving as a peer reviewer of papers/abstracts for inclusion in proceedings or 
presentation at a professional meeting or both. 

e Giving speeches and other activities that contribute to the discipline. 

e Judging professional and academic contests related to the School’s mission. 


e Attending professional meetings. 


3. Service to the University 


This includes activities performed for the School, College or University. Criteria in this category 


are focused on (but not necessarily limited to) these items: 


e Supervising student media and laboratories. 

e Sponsoring and advising student organizations. 

e Serving as chair of School, College and University committees. 

e Serving as a member of School, College and University committees (Faculty 
Senate, Graduate Council, etc.) 

e Serving as outside reviewer of candidates for tenure and promotion. 

e Recruiting outstanding students to the School and engaging in promotional 
activities. 

e Receipt of service awards, honors and grants. 

e Participating in fundraising activities on behalf of the School. 

e Mentoring faculty members. 

e Attending School-sponsored activities (lectures, receptions, etc.). 


e Attending and participating in School faculty meetings. 


4. Service to the Public 


This includes activities that faculty perform for the local, regional or national community in which 


they live. Criteria in this category are focused on (but not necessarily limited to) these items: 
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e Providing academic/professional expertise to the public. 
e Serving as a member of various city, county, state and regional committees. 
e Serving as a member of a community organization or service club (i.e. member of 


board of directors of a nonprofit agency, etc.). 
5. Administrative Duties 


This includes a range of administrative activities of faculty in the School who serve in a variety of 
management and administrative capacities, including the School’s director, associate director for 
undergraduate affairs, associate director for graduate studies, program heads and other faculty with 


similar responsibilities. 


vV. PROCEDURES FOR REAPPOINTMENT, PROMOTION, TENURE AND 
CUMULATIVE REVIEW 


A. Tenure, Reappointment and Cumulative Review 


Qualifying for tenure and promotion derives from a balance of teaching, research/creative 


endeavors and service. 


1. Standards for Tenure 


Section 1.4.2 of the OSU Faculty Handbook provides guidelines for attainment of tenure. All rules 


enumerated below are subject to relevant sections of the OSU Policy & Procedures. 


teaching and research/creative endeavors and at the level of “good” or higher in service. A 


favorable recommendation for the granting of tenure by tenured faculty is basically a prediction 
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that the faculty member under consideration will continue to perform at a same or greater level, 


post-tenure. 


a. Teaching 


Untenured faculty, to meet minimum requirements for tenure, should be assessed at the level of 


“good”; that is, the meeting of expectations, as a classroom teacher and mentor to students. 


Should the faculty member wish to demonstrate excellence in this area, he or she might provide 
evidence of attainment of instructional awards; attainment of external grants devoted to the 
development of innovative teaching techniques and student advising or student performance 
assessment methods; the presentation at regional, national or international conferences of 
techniques and methods that advance pedagogy or the evaluation of student performance; or the 
publication of peer reviewed journal articles that address important or interesting attributes of 
teaching, measurement of student achievement or issues related to student advising or other 


relevant materials or both 


b. Research and Creative Work 





Quality work, in either academic publishing or through any given creative endeavor, must be 
recognized as such in some formal way by one’s peers if it is to have a chance at exerting influence 
in one’s discipline. The tenured faculty shall be willing to evaluate any reasonable example of 
scholarship or creative activity that addresses an interesting or important issue, area or process in 
mass communication. In exchange, the candidate must provide the tenured faculty with external 
evidence that the creative or scholarly activity has achieved recognition as an example of an 
interesting or important contribution to one’s field of study or creative endeavor, or has the 


likelihood of doing so post-tenure. 
Generally speaking, the fewer scholarly or creative products a candidate has for tenure produces 


during probation, the more those products must demonstrate influence, or the likely prospect of 


influence, on one’s field of study or creative interest post-tenure. Therefore, candidates for tenure 
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are encouraged to produce as many scholarly or creative products as necessary to clearly 
demonstrate influence at present, or the likely prospect of influence on his or her area of interest 
post-tenure. What constitutes “as necessary” is that which gives the tenured faculty confidence 
that quality scholarship or creative activity will continue post-tenure once the pressure of attaining 


tenure is no longer present. 


Excellence in research or creative endeavors might include convincing evidence of research or 
creative activity that has achieved demonstrable recognition in one’s field by virtue of its influence 
on that field, using contemporary and generally accepted measures of influence. Such evidence 
can include, but is not limited to, publication in peer-reviewed academic journals, academic awards 
or professional awards for creative work, external research grants or grants designed to finance 
creative endeavors or extensive citations of one’s work by other scholars in the various venues of 


scholarship. 


c. Service 


The demand for service outside the university is especially prevalent in communication. Therefore 
candidates for tenure are encouraged to reflect on their skills as communicators and, in so doing, 
how those skills might be applied to the service of external constituencies. On the other hand, work 


within the university is also considered to be valuable. 


Service is seldom sufficient, in itself, to assure a candidate of tenure. Service should complement 
one’s teaching and research or creative activity. Therefore a candidate for tenure should be careful 


to apportion his or her time to service with this in mind. 

2. Reappointment Procedures 
Procedures for the reappointment review are similar to procedures for the tenure review and follow 
the criteria as set out in the OSU policies and procedures for reappointment. The Director is 


responsible for making the candidate's reappointment review file available to the School’s 


Personnel Committee at least 14 calendar days before a meeting to discuss the candidate's progress. 
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A cumulative record of documentation from previous A & D meetings will also be made available 
to the Personnel Committee. Based on the documentation provided, the Personnel Committee 
provides a written recommendation for reappointment to the Director. After reviewing the 
Personnel Committee’s letter, the Director shall provide a letter to the candidate stating his/her 
recommendation for appointment, including a summary of faculty comments and suggestions. This 
letter of assessment and the faculty report will become a part of the candidate's reappointment file, 
which will be open to the candidate. The director will discuss the review and assessment with the 
candidate. If a negative assessment is made, the candidate has the right to submit a written 


response. 


Comments also may be solicited from students, other relevant faculty members in the college or 


university and from outside reviewers. 


The candidate's reappointment file and materials and a copy of the School’s criteria and standards 
will be forwarded to the college advisory committee. The Dean will provide a letter to the 
candidate stating his/her recommendation for reappointment that includes a summary of 


recommendations from the college advisory committee. 


3. Tenure Procedures 


In accordance with the OSU Faculty Handbook (See Section 1.4.2), all faculty members in the 
penultimate year of probation will be automatically reviewed for tenure unless they resign. A 
faculty member may request an early tenure review. Ordinarily, this is done after consultation with 


the School Director and the tenured faculty members in the department. 


The candidate compiles and submits a file that documents her or his professional accomplishments 


in accordance with the criteria, standards and guidelines the School established in this document. 


25 


The Personnel Committee of the School will advise the Director regarding the qualifications of the 
candidate for tenure and follow the criteria as set out in this document and in the OSU policies 
and procedures for tenure. The Director is responsible for making the candidate's file and the 
School’s tenure criteria documents available to the Personnel Committee at least 14 calendar days 
before the scheduled meeting date to discuss the candidate’s petition. A cumulative record of A & 
D documentation and any outside reviews the Personnel Committee has solicited will be included 


in the candidate’s file materials. 


When appropriate, comments are solicited from students and from other faculty members and 


department chairs/heads in the college or university. 


Personnel Committee members will individually review the candidate's file, considering the 
school’s criteria, standards and guidelines for tenure, and will then meet to discuss the candidate's 
petition. A single letter of recommendation from the Personnel Committee are forwarded to the 


Director and given to the candidate. All minority opinions must be included in the letter. 


Any member of the Personnel Committee may, before the submission of any recommendations to 
the Director, request that the candidate meet with the eligible tenured faculty to discuss, for 


purposes of clarification, the record of accomplishment the candidate submitted. 


The Director will forward a written recommendation to the Dean, accompanied by an explanation 
of her or his judgment. The recommendation of the School’s Personnel Committee and the 
candidate's complete file are also forwarded to the Dean. A copy of the Director’s written 


recommendation is forwarded to the candidate and the Personnel Committee. 

4. External Peer Review 
The School will use external peer review in evaluations for tenure and promotion. Outside 
reviewers recognized as leaders in the candidate’s discipline or profession will be asked to advise. 


The review will be done in the research and creative/scholarly area for those candidates who are 


seeking tenure or promotion or both on the strength of achievement in this area. 
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These guidelines will be used in external peer review: 


a. The candidate and the Personnel Committee each will identify three reviewers. To 
protect the time of external reviewers and to avoid unnecessary delays, the Personnel 
Committee should contact the reviewers and determine whether they are willing to serve 
in this capacity before providing them with the relevant documentation to be reviewed. The 
candidate or the Personnel Committee would then provide additional names if one or more 
of their nominees decline to serve. The goal is to obtain four reviews, two from individuals 
the candidate chooses and two from individuals the Personnel Committee chooses. Outside 
reviewers should hold a position in a peer institution equivalent to or higher than that the 


candidate seeks. 


b. Only the extent and the level of performance of the candidate’s (a) 
research/creative/scholarly work and/or (b) public service will be evaluated; all other items 
pertinent to tenure and promotion must be judged by internal standards using local 


information. 


c. Candidates will have access to review letters unless they have waived their right to see 


them. 


d. Candidate will be encouraged to place in their file unsolicited external peer reviews 


(letters, referee’s comments, etc.) provided they are unedited. 


5. Cumulative Review Procedures 


As noted in the OSU Faculty Handbook (1.1.5.2) “For each tenured faculty member a cumulative 
review shall take place every five years. A review conducted to grant promotion qualifies as a 
cumulative review. The review shall be based on discussion and substantive documentation 
provided by the faculty member.” The School’s Personnel Committee shall provide written 


feedback, including a detailed description of the faculty member’s accomplishments or 


27 


deficiencies. The cumulative review requires individual development plans for each faculty 
member. Faculty members are responsible for their own development consistent with School, 
College and University goals. Any formal development plan should respect academic freedom and 


professional self-direction, and it should be flexible enough to allow for subsequent alteration. 


B. Promotion in Rank 


Consistent with OSU Faculty Handbook policies, individuals may be granted promotion at any 
time. At the level of assistant professor, the period for gaining tenure and promotion to associate 
professor should not exceed seven years. Individuals with truly outstanding credentials may be 


considered earlier. 


For each level of promotion, successively higher levels of achievement are expected. In general, 
an appointment to assistant professor reflects a “good” level of achievement and potential for 
excellence, while promotion to associate professor rests on “excellent” achievements, and 
promotion to full professor is based on attainment of “outstanding” in assigned responsibilities and 
achievements at such a level as would provide national or international recognition in the 


discipline. These distinctions are further set forth in the following: 
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1. Standards for Promotion to Associate Professor 


Section 1.2 of the OSU Faculty Handbook governs promotions in rank. All rules enumerated below 


are subject to relevant sections of the university handbook. 


Promotion to associate professor is typically granted with tenure and therefore the same criteria 


exist. That is, a faculty member must be evaluated at a level of “excellent” or higher in teaching 


Associate professor rank is generally regarded as a rank of transition to professor. Those who hold 
associate professor rank are expected to use their time in the rank to develop at least one 
outstanding area, an area that will distinguish that faculty member on a national or international 
level using usual and accepted measures of performance extant at the time of evaluation. Even if 
that faculty member never attains full rank, the School views attempts at achieving outstanding 


performance in at least one area of endeavor to have inherent merit. 


Clinical faculty members will be evaluated primarily on the evidence of demonstrated excellence 
in teaching and service to the profession and the public. Teaching and service are especially 
important because these faculty members were hired mainly on the basis of their professional 
accomplishments and experience and their ties to the professional community, which are essential 


to the School's mission. 


2. Standards for Promotion to Full Professor 


The successful candidate for promotion to full professor must show consistent attention to 
scholarship, with continued professional development and outstanding achievement since the last 
promotion. Outstanding achievement in research/creative endeavors consists of significant 


accomplishment beyond the credentials submitted for promotion to Associate Professor and 
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usually includes reputable publication, or acceptance, of a single-authored book or monograph or 
a series of publications in major refereed journals since the last promotion. A candidate may 
instead present equivalent work that has demonstrably attained national or international reputation; 
however, the candidate must demonstrate, both to the department and to the outside reviewers, the 
work’s equivalence. Outstanding achievement in teaching consists of demonstrated excellence in 
the classroom, as well as pedagogical or curricular innovation or creativity. Outstanding 
achievement in service consists of a record demonstrating serious commitment to the institution 


and the profession. 


3. Standards for Promotion for Clinical Faculty 


Clinical Instructors, Clinical Assistant Professors and Clinical Associate Professors will be eligible 
to seek promotion after appropriate time of service in rank, usually within seven years from their 
initial appointment. Promotion to the next level for clinical faculty rests on evidence that 
demonstrates excellence in teaching and service. Clinical faculty will normally carry a heavier 
teaching load than their tenured and tenure-track colleagues and are expected to also excel at 


service to the School, the University and the professional community. 
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Appendix 4-3 - Annual Faculty Appraisal and 
Development 


Oklahoma State University Policy and Procedures 


2-0112 
ANNUAL FACULTY APPRAISAL AND ACADEMIC AFFAIRS 
DEVELOPMENT PROGRAM October 2016 


POLICY 


1.01 A review of faculty activities and accomplishments for the preceding calendar year shall be 
conducted by the unit administrator every spring for every continuing faculty member with an 
appointment of .75 FTE or greater for the academic year, regardless of rank or tenure status. A written 
report of activities and accomplishments shall be submitted by the faculty member. This report shall 
include a work and professional development plan. Unit administrators are expected to encourage the 
professional development of each faculty member. 


1.02 Unit administrators shall make available to each faculty member the written Academic Unit 
Standards established by the faculty members as prescribed in the OSU Policy and Procedures Letter 2- 
0902, “Reappointment, Promotion and Tenure Process for Ranked Faculty.” These standards should be 
provided to all faculty members electronically. New faculty members should be provided an electronic 
copy at the time of their appointment. These standards serve as the basis for the evaluation at all levels 
of review and must be consistent with university and college policies, but may exceed them. The unit 
administrator shall endeavor to provide an environment conducive to the achievement of expected 
performance. The unit administrator shall submit a written evaluation that provides detailed descriptions 
of the faculty member’s accomplishments and/or deficiencies specifically as they relate to the written 
Academic Unit Standards. The faculty member’s written report, together with the unit administrator’s 
evaluation, shall serve as the supporting documentation for any merit pay raise or other salary 
adjustment. The completed annual review documentation shall be placed into the permanent record of 
the faculty member and shall be added to an accumulation of performance documents that shall be used 
in any further review. A complete set of annual review documents shall be available for any peer 
committee evaluation, particularly evaluations at the times of reappointment, tenure and promotion. 


PROCEDURE 


2.01 The faculty of each academic unit shall use the written Academic Unit Standards established by 
the faculty members of the unit as prescribed in the OSU Policy and Procedures Letter 2-0902, 
“Reappointment, Promotion and Tenure Process for Ranked Faculty” as the basis for the annual faculty 
appraisal and development. As delineated in Policy 2-0902, Academic Unit Standards serve as the basis 
for the evaluation at all levels of review and must be consistent with university and college policies, but 
may exceed them. The standards must be approved by a vote of all tenured and tenure track faculty 
within the unit, by the appropriate college dean, and by the Provost and Senior Vice President, Academic 
Affairs. 


2.02 Each spring semester, unit administrators shall initiate the appraisal and development process by 
distributing the Annual Faculty Appraisal and Development Program Form and clearly communicating 
to each faculty member the procedures, guidelines, timetable, and performance standards to be used. 


Academic units may choose to adapt the Annual Faculty Appraisal and Development Program Form to 
maximize relevancy of the form to unit faculty. Any changes to the form must be reviewed and approved 
by the Dean of the college in which the academic unit resides. Furthermore, any changes to the names 
of any of the reporting categories (e.g., Teaching Activities) and any changes to, or additions to, the 
names of assignment areas must be submitted to the Division of Academic Affairs for review and 
approval prior to use. 


2.03 Upon receipt of the form and information listed in Section 2.02, each faculty member shall 
provide to the appropriate administrator(s) a written report of his/her activities and accomplishments for 
the preceding calendar year, and future objectives. Reports should be submitted to the unit head on or 
about January 31. Faculty members with split appointments shall submit their report to the unit 
administrators of all the units in which they have assigned responsibilities. Faculty members should be 
aware that the University Ombudsperson (http://president.okstate.edu/ombudsman; 
ombuds@okstate.edu) is available for consultation throughout the annual appraisal and development 
process. In preparing this report, the faculty member shall adhere to the following: 





a. All significant activities and accomplishments for the current appraisal period shall be 
listed as specified in the Annual Faculty Appraisal and Development Program Form. 


b. Outside professional activities listed should follow OSU Policy and Procedures Letter 2- 
0111, “Procedures to Govern Overload Assignments, Outside Professional Activities, and 
Other Outside Activities of Faculty Members.” 


c. Documentation of activities in each assigned area should be provided. 


d. An updated curriculum vitae shall be included to provide an historical context for 
activities in the current appraisal period. 


e. A listing of objectives and planned professional development activities for the coming 
year shall be included. 


2.04 After receiving the written report described in Section 2.03, the unit administrator shall evaluate 
the professional performance of the faculty member and develop an initial draft of a written statement 
which describes and supports his/her appraisal. Unit administrators should prioritize the evaluation of 
tenure-track faculty throughout the review process. In preparing this draft statement, the unit 
administrator shall be guided by the following: 


a. The Academic Unit Standards, described in Section 2.01, shall reflect the goals of the 
unit and the professional standards of excellence common to the unit’s academic 
discipline. These standards shall detail the academic qualification standards for each 
rank, function or specialty within the unit, and must be consistent with university and 
college policies, but may exceed them. The unit administrator must base the evaluation 
on these standards and the faculty member’s assigned role in the unit. 


b. The appraisal must be a definitive statement of the faculty member’s progress, 
accomplishments, and/or deficiencies related to objectives and activities during the 
appraisal period. A restatement of the faculty member’s activities is not adequate. As 
appropriate, the draft appraisal should include comments on the quality and quantity of 


2-0112.2 


performance in the faculty member’s assigned areas of responsibility with respect to the 
Academic Unit Standards. Performance deficiencies with respect to a faculty member’s 
professional assignment are part of this appraisal, even if these deficiencies have 
previously resulted in an admonition. Deficiencies that have resulted in a sanction should 
be handled as discussed below in Section 2.04c. This appraisal is meant to address 
professional performance and should not be used as a means to document or evaluate 
personal misconduct. Such actions are to be addressed as prescribed in the Policy 
Statement to Govern Appointments, Tenure, Promotions, and Related Matters of the 
Faculty of Oklahoma State University (1.13. Disciplinary Actions). 


c. The appraisal shall state the existence of a sanction that was imposed during the appraisal 
period that is not under appeal or the transfer of a sanction record, as described in Policy 
Statement to Govern Appointments, Tenure, Promotions, and Related Matters of the 
Faculty of Oklahoma State University (1.13 Disciplinary Actions). The appraisal should 
not restate the action(s) that lead to the sanction but instead rely on the sanction report for 
corrective actions on the part of the faculty member and procedures for appeal, review, 
modification, and removal of the sanction. 


d. The unit administrator shall ensure that each faculty member has recommended major 
objectives for the next appraisal period. The unit administrator may recommend 
additional objectives and planned development activities to be discussed during the 
appraisal interview. If a major element of professional performance is judged to be 
unsatisfactory by the unit administrator, a detailed written plan for corrective action shall 
be specified by the unit administrator. 


e. For tenure-track faculty who are not tenured, the unit administrator shall make a specific 
statement regarding the faculty member’s progress toward tenure based on the written 
Academic Unit Standards. Furthermore, the unit administrator should recommend 
specific modifications in activities, when necessary, that will contribute to a positive 
tenure decision. 


f. If the faculty member has a split appointment, the draft appraisal statement shall be 
prepared by the unit administrator of the faculty member’s home department after 
consulting with unit administrators of other units in which the faculty member has 
assigned responsibilities. If the involved unit administrators disagree significantly on the 
evaluation, the matter shall be brought to the attention of the dean of the home department 
for resolution before the draft is finalized and sent to the faculty member. 


2.05 After completion of the initial draft of the written appraisal statement, the unit administrator is 
to schedule an individual conference to be held in person with each faculty member appraised. The 
purpose of the conference is to discuss the appraisal and to attempt to resolve any differences between 
the faculty member and the unit administrator regarding the content and meaning of the written appraisal 
statement. As stated above (2.04), tenure-track faculty should receive priority in scheduling of individual 
conferences. In scheduling and conducting the conference, the unit administrator and faculty member 
are to be guided by the following: 
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a. The unit administrator should provide the faculty member with a copy of the draft of the 


written appraisal statement at least three (3) working days before the conference is 
scheduled. 


b. If the faculty member wishes to clarify or change any part of the draft statement, he/she 
should provide the unit administrator with a written statement specifying the requested 
clarifications or changes at least one (1) working day before the conference is scheduled. 


c. During the conference, the unit administrator and faculty member should attempt to make 
changes in the draft appraisal statement that will make it satisfactory to both parties. 


d. Unit administrators shall make special provisions for faculty on leave or otherwise unable 
to meet in person. 


2.06 Following the conference, the faculty member, unit administrator, and dean are to sign the final 
written appraisal statement containing the final written appraisal of the faculty member’s professional 
performance for the preceding calendar year, including any changes they agreed to make. The faculty 
member’s signature simply acknowledges that he/she has seen the written appraisal statement and has 
participated in the conference. Unit administrator review of all faculty members should be complete on 
or about March 31. 


2.07 If there is a disagreement between the faculty member and the unit administrator over the 
appraisal statement that is not resolved during the individual conference described in Section 2.05, the 
faculty member has ten (10) working days after the conference in which to present a written response. 
The written response shall be included as part of the permanent record of the annual review. 


If requested by the faculty member, the unit administrator shall obtain appropriate faculty counsel from 
the unit’s personnel committee or equivalent. This committee will determine whether the appraisal is 
justified, and if so, what measures to improve performance are warranted. The committee shall obtain 
input from both the faculty member and the unit administrator. When deemed necessary, this committee 
may seek other external assistance to aid in their evaluation. The opinion shall be delivered in writing 
to the unit administrator and faculty member within ten (10) working days of the initial request from the 
faculty member. The unit administrator shall provide a written response within five (5) working days to 
the faculty member that addresses the counsel provided by the unit’s personnel committee or equivalent. 
This report should include the rationale for any disagreement with counsel provided by the unit’s 
personnel committee or equivalent unless that requires inappropriate disclosure of confidential 
information. 


If a disagreement between the faculty member and the unit administrator is not resolved subsequent to 
the faculty member’s written response and/or faculty counsel, the unit administrator must alert the dean 
within five (5) working days. The dean must resolve the matter and respond in writing within 20 working 
days to the unit administrator with a copy to the faculty member. If disagreement exists between the 
resolution by the dean and the written faculty counsel, the faculty member can bring the matter to the 
provost for final resolution. 


2.08 The faculty member’s written reports of activities and accomplishments together with the written 
reports, as described in Section 2.03, from the unit administrator shall serve as the supporting 


documentation for any merit pay raise or other salary adjustment. 
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2.09 All documents and records relating to each faculty member’s annual review are to be placed in 
that faculty member’s personnel file. These records shall be available to faculty charged with the 
responsibility of providing appropriate faculty counsel related to reappointment of untenured faculty, 
promotion of untenured and tenured faculty, granting of tenure, and cumulative review of tenured 
faculty. The full annual review process should be completed on or about April 30. 


Summary of Timeline (on or about) 


e December — Reminder is sent out to colleges regarding the appraisal and development timeline. 
e January 31 — Faculty submit materials to their unit administrator. 
e March 31 — Unit administrator review of all faculty members should be complete. 
e April 30 — The full annual review process should be complete. 
Approved: 


Faculty Council, December 12, 2006 
Council of Deans, January 11, 2007 


Executive Team, December 2007 
Form Modified, November 2008 


Revisions Approved: 

Faculty Council, May 13, 2014 and February 10, 2015 
Council of Deans, May 14, 2015 

Executive Team, September 2015 


Revisions Approved: 

Faculty Council, May 10, 2016 
Council of Deans, June 9, 2016 
Executive Team, October 2016 
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OKLAHOMA STATE UNIVERSITY 
[UNIT OR COLLEGE NAME] 
ANNUAL FACULTY APPRAISAL AND DEVELOPMENT PROGRAM FORM 





Name 





Faculty Rank 





Academic Unit 











Period of Evaluation 








In consultation with the unit head, list below the areas of assignment along with the percent effort for each area of assignment 
(Teaching, Research/Scholarship, Outreach and Engagement, Clinical, Administrative, Librarianship) during the current 
appraisal period. 





Area of Assignment for Appraisal Period 





Category Percent | Category Percent | Category Percent 
































For each relevant area below describe activities and accomplishments for the appraisal period. In addition, provide a 
description of evidence of quality and/or impact of effort. Areas of work that are not part of an assignment may be left 
blank. List awards and honors in the area of greatest relevance. 


TEACHING ACTIVITIES: 
(e.g., courses taught, advising students, instructional materials developed, assessment of student learning outcomes) 














RESEARCH, SCHOLARLY, AND OTHER CREATIVE ACTIVITIES: 
(e.g., publications, professional presentations, advisor for graduate theses or dissertations, undergraduate research 
supervised, performances, productions, curated works, patents and intellectual property) 














GRANTS AND CONTRACTS: 
(e.g., proposals submitted, proposals funded, contracts received) 





EXTENSION, OUTREACH, AND ENGAGEMENT ACTIVITIES: 
(e.g., programs developed or revised, extension grants, extension publications [fact sheets, etc.], courses or conferences 
organized) 
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PROFESSIONAL ACTIVITIES (SERVICE): 
(e.g., committees, professional offices or committees, editorial boards, papers reviewed) 





CLINICAL ACTIVITIES: 
Outline primary activities and accomplishments 














ADMINISTRATIVE ACTIVITIES: 
Outline primary activities and accomplishments 





OTHER: 
Outline primary activities and accomplishments 














GOALS AND OBJECTIVES 
List past year’s goals and objectives for areas of assignment, describe accomplishments relative to those goals, and list goals 
for the next appraisal period (add or delete rows depending on need). 

Last Year’s Goals Outcome Next Year’s Goals 








[Identify Area of Assignment] 





1. 1 1 
2 

[Identify Area of Assignment] 
1. 1 1 
2. 

[Identify Area of Assignment] 
1. 1 1 











2: 





Area of Assignment for Next Appraisal Period 





Category Percent | Category Percent | Category Percent 
































A current curriculum vitae should be attached to this document. 


In consultation with unit head and after review of the Academic Unit Standards, I verify this supporting documentation for 
this appraisal period is complete. 





Signature of Faculty Member Date 
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Appendix 4-4 - SMSC Workload Policy 


School of Media & Strategic Communications 
Faculty Workload Policy (Approved by faculty 4/20/18) 


PRINCIPLES AND GOALS: 


The workload policy of the School starts from the conviction that faculty members are highly trained 
professionals and are to be treated as such by administrative units at all levels. Academic excellence is 
inextricably linked to the principle of academic freedom. Therefore, faculty activity must retain a high level of 
personal autonomy; indeed, excessive administrative control over faculty time and activity is deleterious to 
the establishment and maintenance of high standards of academic performance. 


For purposes of measurement and assessment, faculty responsibilities are customarily divided in to three 
areas: teaching, research, service/extension. These areas frequently overlap, and categorization of faculty 
activity by one of these areas is sometimes artificial. Moreover, the activity and emphasis of an individual 
faculty member may vary over time. Opportunities, interests, and the needs of the school are all subject to 
change over time and will influence faculty activity. Therefore, the workload configuration for each faculty 
member is to be negotiated individually with the school director on an annual basis, either as a part of the 
yearly Appraisal and Development (A&D) process or in a separate subsequent individual meeting. In some 
cases, alterations to a typical workload model may be appropriate. These alterations may be requested by the 
faculty member to allow for additional focus on an area of strength or may be assigned by the school director 
in consultation with the faculty member (see below for specifics). 


Whereas teaching and research activities may often overlap in a general sense, it is recognized that research 
and services/extension activities are strongly and adversely influenced by the amount of time directly devoted 
by faculty members to the instructional mission of the school. Faculty members with heavier teaching loads 
generally do not have the time and or energy to focus on producing original research, extension activities, or 
the pursuit of external funding available to those with lighter teaching loads. 


In the allocation of teaching loads among faculty members, the following principles are to be respected by the 
school director: 


1. Equal burden-sharing. Effort will be made to equitably distribute teaching assignments after taking into 
account the ranks, tenured or tenure-line status, research expectations, research foci, teaching 
experience, industry experience, skillsets, and educational backgrounds of faculty members. 


2. Equity in awards. In allocation of rewards, outstanding instruction is to be weighted equally with 
outstanding research. Faculty members who excel in the classroom are to be equally eligible for any 
potential rewards, financial and otherwise, as those with outstanding research and publication records. 


3. Consideration of expertise, interests, and desires. In assigning teaching duties, the school director shall 
take into consideration the professional interests and specialization of faculty members. Whenever 
possible, course assignments shall be consistent with the academic specialization of each faculty member. 
Although not always possible, faculty members should generally be assigned courses they desire to teach 
and are in line with their expertise. However, faculty must be flexible in their desired choices by listing at 
least five SMSC courses regularly offered in the SMSC undergraduate and graduate curricula that they are 
willing to teach through a survey of faculty teaching preferences that is to be distributed by School 
administration every two years. 


4. Equal opportunity for control over career path. Individual faculty members shall be afforded opportunities 
to alter the balance among professional activities on an equal basis. 


5. Consideration of junior faculty members. Since research is a major element of promotion and tenure 
decisions, untenured faculty members shall be given reduced teaching loads when possible in order to 
facilitate their efforts to build publication records. 


6. Advanced notice for teaching assignments: All faculty should be informed of their tentative course 
assignments and the area heads consulted about course offerings in their programs before a full draft of 
the overall schedule is sent to faculty in advance of each term. This provides faculty more time to prepare 
for upcoming semesters and to raise any concerns with administration before the final schedule is 
published. 


7. Time allocated for research focus: Unless requested otherwise or agreed to by individual faculty, tenure- 
line faculty on 2/2 fall/spring loads should be limited to teaching classes and labs that collectively meet no 
more than three days per week to allow time to focus on research. Tenure-line faculty on a 3/2 or 2/3 
fall/spring load should be limited to teaching classes and labs that collectively meet no more than four 
days per week to allow time to focus on research, although administrators should strive to limit teaching 
days for all tenure-line faculty, who have at least 30% of their workload assignment dedicated to research, 
to three days or less per week. Those figures do not include any courses that are counted as overloads, or 
taught separately through outreach or are outside of a faculty member’s base fall-spring courseload (e.g., 
a tenure-line faculty member requesting a course to teach during an intersession could be assigned class 
meetings five days per week). 


8. Engagement with students: As a professional-oriented School, faculty are expected to interact with and 
assist students outside of the classroom. At a minimum, faculty who are teaching any courses that meet in 
person must post at least two available office hours per week in syllabi for that semester. These office 
hours can be the same for multiple courses (e.g., 8-11 a.m. on all syllabi for all courses). Any professor who 
teaches fully online courses must post a minimum of one virtual office hour per online class. 


In allocation of teaching loads the following additional factors are to be considered by the school director: 


1. Level/type of course. 

2. Number of required contact minutes with students (i.e., lecture and lab meeting times) assigned to the 
course instructor as part of the course. 

Size of course enrollment. 

Extent and number of course preparations by faculty members. 

Demands of university service activities on faculty time. 

Demands of professional development activities on faculty time. 


OY E 


In all cases, assignments, judgments, and evaluations made by the school director in consideration of the 
above principles and factors shall be consistent with the FTE allocation for each faculty member. 


In all cases, assignments, judgments, and evaluations made by the school director shall be consistent with the 
availability of resources. 


TEACHING LOAD ASSIGNMENT POLICY: 


Untenured, tenure-track faculty members shall be afforded a 2/2 course load (12 teaching hours total) per 
academic year whenever possible. Under no circumstance should the course load of an untenured, tenure- 
track faculty member ever exceed 2/3 or 3/2 (15 teaching hours total) per academic year. In the first academic 
year of appointment, an untenured assistant professor shall normally be afforded a 1/2 or 2/1 course load (9 
teaching hours total). Additionally, in the year after successful reappointment (i.e., generally a faculty 
member’s fourth year on the tenure clock), an untenured assistant professor shall normally be afford a course 
release, allowing that faculty member to revert back to a 2/1 or 1/2 load for that one academic year. These 
assignments shall be arranged by the school director, in consultation with the faculty member, and subject to 
the principles articulated in the workload policy. 


Tenured faculty members generally maintain an annual 2/2 (12 total teaching hours) or 3/2 or 2/3 (15 total 
teaching hours) over the fall/spring academic year. Tenured faculty may opt for a higher teaching load per 
semester, which would be reflected in FTE documentation. The teaching load for clinical faculty, lecturers, and 
visiting (teaching) assistant professors is generally a 12-hour load per semester or as determined by the school 
director. This document does not recognize intersession, summer, or overload teaching assignments. These 
hours are voluntary and are accounted for outside of the faculty FTE. 


Although these percentages may vary by individual faculty based on assignments, for purposes of 


performance assessment, the difference between the four loads may breakdown as follows with hours in 
parentheses signifying teaching hours taught over the combined fall/spring terms: 


2-2 load (12 hrs.) 3-2 or 2-3 (15 hrs.) Clinical Faculty (24 hrs. Lecturers/VAP (24 hrs. 


(T/TT) (T/TT) 
Teaching 40% 50% 90% 100% 
Research 50% 40% 0% 0% 
Service 10% 10% 10% 0% 


This choice is subject to review and alteration as part of the annual Appraisal and Development (“A&D”) 
process involving the individual faculty member and the school director. Changes in individual load 
assignments are to take effect in a manner consistent with the school’s course scheduling deadlines. Tenured 
and tenure-line faculty members’ base (fall/spring) teaching loads should not be increased from the terms of 
their original offer letters unless a faculty member receives a rating of below expectation or lower on 
research/scholarship for three consecutive years on a faculty member’s A&D. However, tenured and tenure- 
track faculty members can be assigned up to one teaching-credit hour over their combined assigned fall/spring 
teaching loads due to credit for a separate lab or extended-minutes lecture/lab courses. This extra hour must 
be accounted for in their A&D, but not for their teaching loads or annual workload percentage assignments. 
For example, a tenure-line faculty member on a 2/2 teaching load may be assigned one extended-minutes 
lecture/lab combo or a course with a separate lab over the fall/spring terms without affecting that faculty 
member's teaching load. Any additional such assignment must result in an adjustment of that faculty 
member’s teaching load and workload assignment. 


Teaching Assignment Credits and Guidelines Based on Contact Minutes Required with Students Per Class: 


1. (a) 50-minute, 3-day-a-week undergraduate lecture classes, (b) 75-minute, 2-day-a-week classes, and (c) 
lecture/lab courses all worth 3 credit hours that require 170 total minutes or less of instructor contact minutes 
with students per week all count as 3 teaching hours for teaching loads and workload assignments. 


2. Online and hybrid courses worth 3 credit hours and taught within load during the fall or spring semesters 
count as 3 teaching hours for teaching loads and workload assignments. 


3. 170-minute, one-day per week graduate courses worth 3 credit hours count as 3 teaching hours for 
teaching loads and workload assignments. 


4. 100-minute lecture courses worth 3 credit hours with a separate lab up to 110 minutes or extended- 
minutes combined lecture/lab courses that require more 171 or more direct contact minutes with students 
count as 4 teaching hours for teaching loads and workload assignments. However, faculty may be assigned 
one of these courses annually over the fall/spring terms without an adjustment in teaching loads or workload 
assignments. If assigned two or more extended-minutes courses over the fall/spring terms, then all extended- 
minutes courses must be counted for teaching loads and workload assignments. 


5. Each subsequent lab (no more than 110 minutes each) added to a teaching assignment will count an 
additional hour to a faculty member's teaching load for teaching loads and workload assignments. Thus, a 
100-minute lecture course with two separate 110 minute labs counts as 5 teaching hours even though the 
class is worth 3 credit hours for students. A 100-minute lecture course with four separate 110 minute labs 
counts as 7 teaching hours. If mutually agreed upon by the faculty member and director, this can be adjusted 
down to account for smaller lab sections. For example, a faculty member who could teach three full or near- 
full to capacity separate labs as part of a course, but requests four labs with smaller enrollment to provide 
more individual attention to students would only receive 6 teaching hours for that course and four separate 
labs, so long as that is agreed to in advance by both the faculty member and director. 


6. Preference will be to assign courses with additional labs taught by the course instructor to non tenure-line 
faculty. No tenured or tenure-track faculty member will be assigned more than one course in their annual 
base fall/spring load that includes more than 170 contact minutes (lectures and labs) with students for three 
(3) hours credit unless that faculty member requests assignments of extended-minutes courses that better fit 
her/his expertise. If so, that faculty member’s workload assignment and A&Ds will be adjusted to account for 
the extra time required in the classroom. Faculty may, during the annual A&D process, agree to additional 
lecture/lab courses in exchange for an adjustment in teaching and research recent efforts. 


7. Courses counting for 1 or 2 credit hours count as 1 or 2 teaching hours, respectively, in the teaching model. 


RESEARCH 


Housed at a land-grant, research-intensive university, primary mission of the School is to promote scholarly 
research and professional performance. Accordingly, most tenured and tenure-line faculty carry reduced 
teaching loads to allow time for research. Thus, faculty with lower teaching loads will have a greater 
expectation for producing scholarship. In the processes of workload assignments, FTEs, A&Ds, and various 


types of rewards, the following types of primary research produced by SMSC scholars are to be recognized 
and prioritized by the Director, although other types of scholarship should be recognized on a case-by-case 


basis: 


1. 


4. 


6. 


Refereed and peer-reviewed academic journal articles and books (authored and edited). These are the 


most common type of scholarship outlet for research produced in the School and should be factored 
into workload assignments and A&Ds. Factors to be considered in the evaluation of these publications 
include (A) quality of journal based on acceptance rate, publisher, and affiliation; (B) solo vs. group 
authorship; (C) author ordering (e.g., first author on a journal article receives more credit than being a 
third author); and (D) reputation of publisher of books and handbooks. 


External grants. The successful procurement of external grants as a PI or co-PI should be recognized in 
a faculty member’s A&D and possibly affect that member’s workload assignment as noted above. 
Unsuccessful attempts to attain external funding should be positively noted in faculty members’ A&Ds 
but have no affect on workload assignments. 


Book chapters and refereed monographs. These publications are valuable, but recognized ona 
secondary level compared to refereed journal articles and authoring/editing books. Factors to be 
considered in the evaluation of these publications include (A) solo vs. group authorship; (B) author 
ordering (e.g., first author on a journal article receives more credit than being a third author); (C) 
reputation of publisher of books and handbooks; (D) reputation of editor or authors of a book or 
handbook. 


Refereed conference papers and presenting papers as part of refereed conference panels, published, 


editor-reviewed academic articles, and published book reviews in refereed journals. These will be 
considered in A&Ds, but do not affect annual workload assignments. Factors to be considered in the 


evaluation of these publications include (A) solo vs. group authorship; (B) author ordering (e.g., first 
author on a book chapter receives more credit than being a third author); (C) reputation of conference 
and/or sponsoring organization; (D) publisher of editor-reviewed academic journals. 


Creative projects. Due to its ties and need to stay relevant with the industry, these types of creative 
works should be given equal credit to more traditional outlets for scholarship. However, to receive the 
highest level of credit equivalent to research articles, books, and external grants, creative projects 
must be recognized in juried and/or peer-reviewed competitions and require extensive time to 
complete. Factors to be considered in the evaluation of these publications include (A) reputation of 
conference and/or sponsoring organization; (B) published reviews of the creative work; (C) awards won 
via this project; (D) solo vs. group authorship; (E) author ordering, although serving as last producer 
after a list of students must be viewed favorably). 


Internal grants. These are to be recognized as a successful means of junior, tenure-line faculty 
advancing their careers in A&Ds, but are not factored into workload assignments. 


Course Release Reward System for Research/Creative Works Production 


Faculty members with 15-hour annual teaching loads (3/2 or 2/3) or higher who are not already receiving a 
course release or course reduction for any purpose may qualify for a reduced teaching load for up to one 
course annually in either the fall or spring semesters through meeting any of the criteria below. However, 


faculty assigned teaching loads cannot be reduced to lower than 12 hours (fall and spring terms combined) 

by exceeding the output required below. Faculty must provide notice of eligibility for a potential course 
reduction when submitting the annual faculty appraisal and development program form. Faculty are not 
eligible for two course reductions in the same year through the research/creative works formula below unless 
they can potentially buy out multiple courses through successful procurement of an external grant. In rare 
cases, a faculty member’s earned course reduction could be banked but delayed a year, because another 
faculty member from the same area of teaching expertise already earned a course reduction and thus the 
School might have difficulty staffing courses in that area if both faculty received course reductions in the same 
academic year. Further, while intra-department collaborations are strongly encouraged, credit toward a 
potential course reduction earned from a book that involves multiple School faculty members will only go 
toward the faculty member in the earlier ordering of authorship of that book. The same rule does not apply 
for journal articles, where both faculty may receive credit toward a potential course reduction. 


1. Publication of an average of at least one refereed article per year in a quality journal over a three-year 
period with at least 50% of that faculty member’s publications as lead/solo author, not to exceed two 
years without additional published work. (For example, a faculty member who published three or more 
articles in one year would still be limited to three years of reduced course load on the collective basis 
of work if that faculty member does not have any articles published in years No. 2 and No. 3 of that 
period). Published works for this system and for A&Ds may be counted for only one year, either the 
year that is in press or the year that it is published. 


2. Procurement of a contract for a book-length manuscript or other major work (e.g., computer 
programs) from an established and recognized publishing house, provided that the work in question is 
either a scholarly work or a textbook, including new editions of a textbook already in circulation. Such a 
contract qualifies the faculty member for a reduced teaching load for one semester of one year. 


3. Publication of a book (scholarly or text) through a major publisher or as part of a national series as 
author or co-author qualifies the faculty member for a reduced teaching load for two semesters over a 
two-year period. 


4. Publication of a book (scholarly or text) as editor or co-editor qualifies the faculty member for a 
reduced teaching load for one semester. 


5. Procurement of a grant from an external source (i.e., outside the university) of $10,000 or more as a Pl 
or Co-PI qualifies the faculty members involved for reduced teaching loads for one semester or the 
duration of the project if less than two years, after which the reduced load may be renewed or 
cancelled depending upon the funding status of the project. Being listed as a secondary researcher 
(non-PI or co-Pl) on an external grant is credited in a faculty member’s A&D, but does not affect 
workload assignments or teaching loads. 


6. Publication of a creative project that takes extensive time (e.g., full documentary counts, but a column 
in the Stillwater News Press does not) through a juried or peer-reviewed competition as lead/solo 
director/producer/author, etc. or as a secondary director/producer/author, etc. in a work involving 
OSU students could potentially qualify a tenured faculty member for a reduced teaching load for one 
semester. To qualify, this project must take extensive time to complete. 


7. Faculty members may request release from teaching responsibilities altogether for one semester to 
pursue a specific research or professional activity. Such requests are subject to the terms of the 
Research Leave Policy. 

SERVICE 


This proposal calls for establishment of THREE separate service categories for the School—Academic-Internal, 
Academic-Academy and Applied-External. Faculty are encouraged to volunteer for service that best fits their 
interests and expertise. The director is to equally recognize the value of all three types of service in doing 
A&Ds, but that does not mean that all activities falling under the various types of service must be accounted 
equally. For example, serving as an ad-hoc reviewer for a single paper/abstract submitted to a scholarly 
conference is not equivalent service to being on an editorial board of a top scholarly journal. 


Examples of Academic-Internal service would include: 


Membership on School’s permanent committees (e.g., Personnel, Technology); 
Membership on School’s job search committees; 

Membership on College/campus committees (e.g. A&S council, etc.); 

Organizing and directing SMSC sponsored events for high school, college students; 
Advising SMSC student organizations; 

Serving as an area head for one of the School’s three undergraduate programs; 
Making academic presentations to campus groups (outside of SMSC). 


Examples of Academic-Academy service would include: 


Service as officer and or conference planner for national-international organizations (AEJMC, BEA, NCA, 
ICA, etc.); 

Service to state academic groups such as OBEA; 

Serving on editorial review boards; 

Reviewing papers for journals and or conferences; 

Serving as editor (or guest editor) of academic journals; 

Serving as outside reviewer for tenure and promotion cases from peer institutions. 


Examples of Applied-External service would include: 


Presenter/panelist in professional workshops, conferences; 

Used as news source for mass media story (print/video/online); 

Working as professional consultant/advisor/board member for outside media, a professional or 
academic organization, and/or for a strategic communication project or campaign. 
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Instructor: James Testlinstructor 











Mark as shown: oK oO O Please use a ball-point pen or a thin felt tip. This form will be processed automatically. 
Correction: O M C&D Please follow the examples shown on the left hand side to help optimize the reading results. 





Student surveys are conducted for every instructor and course at Oklahoma State University. Information gained from this 
survey will be useful to the instructor, the department, students, and administrators responsible for instruction at OSU. You are 
asked to give some information about yourself, then your views of the INSTRUCTOR and then your views of the COURSE. In 


addition, space is also provided for written comments. 


Information about yourself 


My college is: 
O Agricultural Sciences and Natural C] Arts and Sciences C] Spears School of Business 
Resources 
CI Education LI Engineering, Architecture and CI Graduate College 
Technology 
O Human Sciences LI Veterinary Health Sciences (J University College 
LI None of these 
Classification: 
LC Freshman C] Sophomore J Junior 
CI Senior C] Graduate C High School/Concurrent 
CO Undergraduate (non-degree seeking) LI Graduate (non-degree seeking) L] Graduate (professional, College of 
Veterinary Health Sciences) 
Purpose for taking the course: 
LO Major C] Related to major C] General Studies 
L] Elective 
Course is required: 
Yes OJ No 
Type of course: 
O Lecture CI Lab O IPI 
L Short Course 
Rank the INSTRUCTOR 


ee High Average Low Very Low 
Hig 


Preparation and organization: 


O 
O 
OO 
E 


Effort devoted to teaching: Eho L] o 
Presentation of materials: re ot EL E o 
Knowledge of subject: Ph Ge Ey E E 
Ability to explain subject matter: o> ee et eh 
Positive attitude toward students: Fl sik. To) ly E] 
Overall INSTRUCTOR appraisal: a H H-H G 
Views on the COURSE 
ô % 
2 Sp, K 
A A %, 
HOG w% 
| learned a lot in this course. 0O Ef e (E O O 
Workload was appropriate for the credit hours. C] O O O O 
Assignments were relevant and useful. E O O O O 
Testing and evaluation procedures were good. O O O C] O 
Students were adequately involved. O O O O L 
This course was worthwhile to me. O O O O O 
Overall, this was a good COURSE. 0O O O O O 
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Please add any comments you wish about the following: 

















Course 








Instructor 











Instruction 





Teaching Assistants / Associates 








Laboratory, Practicum, or Discussion Section 








Work Load 





Examinations 











Grading 





Textbook 











Other Comments 
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ekg University Assessment and Testing 


Spring 2019 Student Survey of Instruction (SSI) Results 


Dear <<Instructor First Name>> <<Instructor Last Name>>, 


In the attached report you will find the Student Survey of Instruction (SSI) results for the 
following course: 


<<Course Name>> 
The SSI results report is comprised of the following sections: 


e Overall indicators 

e Information about yourself (demographic information reported by the students who 
completed the survey) 

e Rank the INSTRUCTOR 

e Views on the COURSE 

e Comments Report —text comments submitted by students 

e Profile — graphic representations of the averages of each survey question 


For a more detailed explanation of the information contained in this survey report, an 
annotated PDF of a sample report is available on the SSI website at the following link: 
http://uat.okstate.edu/sites/default/files/assessPDFs/survey/traditional.pdf 


If you have questions or comments please let me know. 
Thank you! 


Susan Sharpton 

Assessment Specialist 

University Assessment and Testing 
201 UAT 

Stillwater, OK 74078 


405-74-6924 
s.s.i@okstate.edu 


http://ssi.okstate.edu 
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Rank the INSTRUCTOR This section ‘i av=3.85 
summarizes the overall dev.=0.99 

Views on the COURSE __ averages for the r — ~— 
instructor and course. dev.=0.8 





(he SM SSR ce cece n erence errpernner ot acts) 


















Leg e n d Absolute Frequencies of answers. __Std. Dev. Mean Median Quantile 
Relative Frequencies of answers. ~~ 2 \ “ 25 AA n=No. of responses 
Question text s av.=Mean 
Use this legend to help | ‘""" md=Median 
with interpreting the ab.=Abstention 
histograms that appear a 
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on the next pages. 











{Information about yourself _ 





My college is: 
Agricultural Sciences and Natural Resources 39 
Arts and Sciences ea 
This section includes Spears School of Business (] 
bar graphs and Education () 


frequency counts for 


= Engineering, Architecture and Technology (9 
survey participants' 


demographic 
information. 


Graduate College 


Human Sciences ( ) 


Veterinary Health Sciences 





University College 





None of these { ] 
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Classification: 


Freshman({_ 7 n=42 
Sophomore ( a. ) 18 
Junior ( 13 





Senior( 4 

Graduate 0 

High School/Concurrent 0 

Undergraduate (non-degree seeking) 0 

Graduate (non-degree seeking) 0 

Graduate (professional, College of Veterinary Health Sciences) 0 

Purpose for taking the course: 

Major { ean 10 n=42 


Related tomajor{ 9 
General Studies ( } 21 


Elective B 2 








veel ee ee A ia 


Type of course: 


Lecture Í J __)42 n=42 








Lab 0 
IPI 0 
Short Course ò Stats for eact 





question. 
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40.5% 35.7% 









Preparation and organization: This section uses a 5- 
point scale from 1-5 for 


calculations. The 
previous paper SSIs also 





































Effort devoted to teaching: used a 5-point scale for Very High Lp 
calculations, which ran from indat 5 
0-4. The scale is corrected — 
—-- here to provide "Very Low" z MEE E S OR 
Presentation of materials: responses with a value (1) Very High n=42 
rather than no value (0), nen 
dev.=1.23 
Knowledge of subject: i n=42 
3 J woe av=4.4 
md=5 
dev.=0.77 
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Ability to explain subject matter: Very Low Very High T 
av.=3. 
d=3 
For further HEES 
explanation of this a ee 
Eae ne aa section and the next, ee ek a e te fran ee 
iti R = 0% 2.4% 11.9% 42.9% 42.9% ; 7 
Positive attitude toward students: use the legend on Very Low Very High ee 
page 1 of the report. dev-0.77 
Overall INSTRUCTOR appraisal: Very Low Very High te i“ 
av.=3. 
md=4 
= dev.=1.08 
This section uses a 4- 
. a" point scale from 1-4. The 
[Views on the Ç previous paper SSIs also used Se E aeons 
el a 4-point scale, which ran from 
| learned a lot in this course} 4-4, Both versions include a Definitely Yes 42 
possible response of "Not md=3 A 
Applicable" which is NOT ae 
Ae pen ET mayen ah ALINE calculated in the results. ----- 2-7 erg occ 
Workload was appropriate for the credit hours. Definitely No ape en Definitely Yes He ‘i 
aVv.=s, 
md=3 
dev.=0.65 
Assignments were relevant and useful. Definitely No 
Testing and evaluation procedures were good. Definitely No 


md=3 
dev.=0.75 





Students were adequately involved. Definitely No 








This course was worthwhile to me. Definitely No 








Overall, this was a good COURSE. Definitely No 


dev.=0.84 
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Profile 


These profile line graphs present an 











Subunit: Arts & Sciences 
| Name of the instructor: John Doe alternative way to view the rankings from 
} ie ee ener ENED TEE ae SON the previous pages. These profile line 
(Name of the survey) s x 
graphs can be used to see a "snapshot" of 
Mawes used Inthe profileting; Meare the mean responses to all questions in each| _ 
section of the course evaluation at once. 
ERO TA pec eh A ee ene etre) 


Preparation and organization: Very Low ET E ES Very High mas acdoemekoansTn 
Effort devoted to teaching: Very Low E DS D. | Very High ha ainiin 
5 
Presentation of materials: Very Low H Very High n=42_av.=3.40 md=3.00dev=1.23 
| | [> | Very Hi n=42  av.=4.40 md=5.00dev.=0.77 
Ability t lain subject matter: Very L sil Very High 
i ten a csi oe =a ware n=42  av.=3.10 md=3.00dev.=1.28 


W 
Positive attitude toward students: Very Low ae a ae Very High n=42  av=4.26md=4.00dev=0.77 
Overall INSTRUCTOR appraisal: Very Low |__| +] Very High n=42  avi=3.62 md=4.00dev.=1.08 


[Views on the COURSE — 


I learned a lot in this course. Definitely No — 4— k3 | Definitely Yes 49° ees rapes palette 
D i Defini 
Assignments were relevant and useful. Definitely No E S E efinitely Yes n=42  av.=3.14 md=3.00 dev.=0.65 
Testing and evaluation procedures were good. Definitely No S D Definitely Yes n=42  av=2.98 md=3.00 dev.=0.75 
ff 
Stud i k i i 
tudents were adequately involved Definitely No t+ Definitely Yes n=42  av.=2.38 md=2.00dev.=0.91 
This course was worthwhile to me. Definitely No Sa Definitely Yes n=42  av.=2.50 md=3.00dev.=0.92 
Overall, this was a good COURSE. Definitely No |__| Definitely Yes n=42 _ av.=2.69 md=3.00dev.=0.84 


Knowledge of subject: Very Low 














Workload was appropriate for the credit hours. Definitely No Definitely Yes 





n=42 = av.=3.21 md=3.00dev.=0.65 
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a a ee eee ASO EN OL sere arn eC 








(Please add any comments you wish about the following: asad 


Course 


m Fake Course 
a Pointless. | see no point in having to take this course. 
i The presentation of materials did not seem to follow a logical order. Difficult to follow along in textbook. Textbook presented things in a 


very straight forward manner but then lecture would only be confusing. 
a This is a difficult subject, but | do think that the department could do things to improve it. 
_ having homework due at 6 oclock was really difficult. | work and sometimes am not able to start my homework until late, this would 


stress me out knowing it had to be done by 6. 


m n/a 
This page and subsequent pages provide 
the written comments survey participants 
made in regards to each of the following 
categories: Course, Instructor, 
Instruction, Teaching Assistants/ 
Associates, Lab/Practicum/Discussion 
Section, Work Load, Examinations, 
Grading, Textbook, and Other. 















06/11/2015 Class Climate'evaluation Page 5 





nn nnn —— ee 


Instructor 


06/11/2015 Class Climate evaluation 


Couldn't hear or understand him, which made going to class a waste of time. | basically taught myself. 

Dr. Doe had a very positive attitude, came to class prepared, and was always very organized. | appreciated his effort, expertise, and he 
was fun. 

| couldn't understand the material being presented because of the language barrier 

Made changes to originally stated procedures midway through the semester that negatively effected grades. Not very consistent with 
expectations of students. 

Professor was really good about coming prepared to teach everyday and was also really good with keeping the class informed on the 
happenings of the course. This was very helpful in balancing a heavy course load this semester. 

He is way too nice to students, and too hard on himself. Please, do not tell the students that you have not done a good job of teaching, 
That is one of the worst things you can say. You must be confident in your teaching ability for the students to respect you. Also, often 
times you would tell us how so few students are coming to class and how you are going to check attendance - | felt like you were just 
preaching to the choir during these moments. The students you were telling this to were always there - so it didn't matter. 

He was difficult to understand and follow at times. 

He was very good at explaining the material and was very helpful if | needed something. He was always available to help me during 
office hours and easy to understand. 


John Doe 
Very hard to understand at times. He copied slides from the book and read straight from them. | was getting more out of doing the 


homework on my own than coming to class. Also doesn't know how to talk to students very well 


Very nice guy, however, it can be hard to understand him. 
Wants to help out his students as much as he can, but has a difficult time teaching. It is not one of his strengths. 
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SII SST 


Instruction 


m Access to Powerpoint slides at the beginning of the units would have been very helpful. 

m Bad. | didn't understand what was going on in the class, | taught myself everything | know. 

@ Couldn't understand him. 

m Ok, sometime hard to understand. 

Sometimes talked a bit too fast, but good otherwise. 

m Too large of a language barrier 

m Very good effort in teaching. 

m average 

m confusing, | had to teach myself all the material. 

it would've been helpful to have the lectures posted after we finished it in class for those who missed or just couldn't keep up. It made 
it hard to learn when they were only available 2 days before the exams 


m n/a 
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fea a Og EI I Ee SS 
Teaching Assistants / Associates 
m Never saw the TA. 


E n/a 


i re a 
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ee 


Laboratory, Practicum, or Discussion Section 
m N/A 


E n/a 


06/11/2015 





Class Climate evaluation 
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ew a S ee 
Work Load 
= appropriate to course hours. 


E n/a 
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nr- a a eS SS 
Examinations 

E Having multiple choice and true/false questions worth 10 points is a little absurd when the questions are so poorly written 

m | thought the exams were always perfect - not too hard and not too easy. 

m Tests were relevant to the material, and he gave us plenty of study material before the tests. 

m The exams focused more on definitions and specifics than what was in the homework. 

m They were not like the homework at all, which made them confusing and not seem fair. 


m Very hard 
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ee ee 
Grading 


m Good. 
E | liked the way he graded because he gave points for showing that you understood/knew how to solve the problem, even if you solved it 


wrong. 
There were a few instances where | couldn't understand the comments he made on my returned quizzes so | wasn't really sure what | did 


wrong. 
E Updates to D2L would have been appreciated, especially since the weight of certain assignments changed midway through the semester. 


m appropriate. 
m n/a 
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a en SSS eae SS SS 
Textbook 

m Didn't really use the book. Don't see a point in buying it. 

m Textbook was more helpful than the professor was 

E Textbook was really unnecessary, waste of money because | never used it. 

E Very effective, A saving grace. 

E n/a 


E not necessary. 
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DS —— 
Other Comments 

m | enjoyed the class, he was a positive and professional instructor. 

m n/a 


m He is so sweet!!! 
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Appendix 5-1 - Faculty Scholarship 


Jami Armstrong Fullerton, 
Professor and Peggy Welch Endowed Chair in Strategic 
Communications 


Books 


Holtzhausen, D., Fullerton, J.A., Lewis, B. H., & Shipka, D. (under contract). Principles of 
Strategic Communications. Thousand Oaks, CA: SAGE Publishing. 


Fullerton, J. & Kendrick A. (2017). Shaping International Public Opinion: A Model for Nation 
Branding & Public Diplomacy. New Y ork: Peter Lang Publishing. 


Refereed Journal Articles 


Abdi, K., Talebpour, M., Fullerton, J., Ranjkesh, MJ & Nooghabi, H.J. (2019 in press) 
Identifying Sports Diplomacy Resources as Soft Power Tools. Place Branding & Public 
Diplomacy. 


Kendrick, A. & Fullerton, J. (2019 in press) Dimensions of News Media Literacy among U.S. 
Advertising Students. Journal of Advertising Education. 


Abdi, K., Talebpour, M., Fullerton, J., Ranjkesh, MJ & Nooghabi, H.J. (2018). Converting sports 
diplomacy to diplomatic outcomes: Introducing a sports diplomacy model. International Area 
Studies Review. https://doi.org/10.1177/2233865918808058 





Fullerton, J., Kendrick, A., & Broyles, S.J. (2017). Cultural factors in tourism advertising 
effectiveness: Segmenting the U.S. market for Cuba. Southwestern Mass Communications 
Journal, 32(1). 


Kendrick, A. & Fullerton, J. (2017). Mentors and minority advertising students: A survey of the 
2017 Most Promising Multicultural Student class. Journal of Advertising Education. Special 
Issue on Diversity, 21(2), 25-32. 


Fullerton J. & Kendrick A. (2017). Profiles of advertising students: Are “Creatives” different 
from the rest? Journalism & Mass Communications Educator, 72(3) 349-365. 


Fullerton, J., Kendrick, A., & Broyles, S.J. (2017). Diplomatic Relations and Tourism 
Advertising Effectiveness: U.S. travel interest to Cuba. Journal of Marketing Communications, 
3 Aug. online first. http://dx.doi.org/10.1080/13527266.2017.1359650 





Fullerton, J., Kendrick, A., & Broyles, S.J. (2017). Attitude change among U.S. adults after the 
Castro-Obama announcement: The role of soft power in agenda setting. Special series on Soft 
Power. Palgrave Communications 3, Article number: 17018, doi:10.1057/palcomms.2017.18 


Edward (Ted) M. Kian, 
Professor and Endowed Welch-Bridgewater Chair of Sports Media 


Pedersen, P.M., Laucella, P., Kian, E.M., & Geurin, A. (2016). Strategic sport 
communication (2nd ed.). Champaign, IL: Human Kinetics. 


Kian, E.M., &, Schultz, B., Clavio, G., & Sheffer, M.L. (2018). Multimedia sports 
journalism: A practical guide for the digital age, New York: Oxford. 


Vincent, J., Harris, J., Kian, E.M., & Billings, A. C. (2018). The Isles of 
Wonder- a New Jerusalem? British newspaper narratives about the opening 
ceremony of the XXXth Olympiad. Sport in Society: Cultures, Commerce, Media, 
Politics. Advanced online publication. DOI: 10.1080/17430437.2018.1515203. 


Cleland, J., Magrath, R., & Kian, E.M. (2018). The Internet as a site of decreasing 
cultural homophobia in football: An online response by fans to the coming out of 
Thomas Hitzlsperger. Men and Masculinities, 21(1), 91-111. 


Sanderson, J., Barnes, K., Williamson, C. & Kian, E.M. (2016). ‘How could 
anyone have predicted that #AskJameis would go horribly wrong?’ Public relations, 
social media, and hashtag hijacking. Public Relations Review, 42(1), 31-37. 


Kian, E.M. (2015). A case study on message board and media framing of gay male 
athletes on a politically liberal website. International Journal of Sport 
Communication, 8(4), 500-518. 


Kian, E.M., Anderson, E., & Shipka, D. (2015). ‘I am happy to start the 
conversation’: Examining sport media framing of Jason Collins’ coming out. 
Sexualities, 18(5-6), 618-640. 


Kian, E.M., Anderson, E., Vincent, J., & Murray, R. (2015). Sport 
journalists’ views on gay men in sport, society and within sport media. International 
Review for the Sociology of Sport, 50(8), 895-911. 


Kian, E.M., Ketterer, S., Nichols, C., & Poling, J. (2014). Watchdogs of 

the Fourth Estate or homer journalists? Small and mid-sized newspaper coverage of 
local BCS college football programs. The Sport Journal, Vol. 17, first published 

online March 10, 2014. Available at: http://thesportjournal.org/article/watchdogs-ofthe- 
fourth-estate-or-homer-journalists-newspaper-coverage-of-local-bcs-collegefootball- 
programs/. 


Kian, E.M., Lee, J.W., Gregg, E., & Kane, J.J. (2014). Rivals.com framing of 
FBS-FCS football games: Immoral mismatch or just another game. Journal of 
Contemporary Athletics, 8(2), 75-91. 


John McGuire, 
Professor 


Authored & Edited Books 


Armfield, G.A., McGuire, J., & Earnheardt, A.C. (Eds.). (2019). The ESPN Aftereffect: The 
Changing Sports Media Marketplace. New York: Peter Lang. 


McGuire, J., Armfield, G., & Earnheardt, A.C. (Eds.) (2015). The ESPN Effect: Exploring the 
Worldwide Leader in Sports. New York: Peter Lang. 


Book Chapters 


McGuire, J. (2019) SportsCenter at 40: Evolving with the times. In G. Armfield, J. McGuire, & 
A. Earnheardt (Eds.), The ESPN Aftereffect: The Changing Sports Media Marketplace. Peter 
Lang. 


McGuire, J., & Murray, R. (2016). Attitudes of sports print journalists about developing 
electronic media skills: A case study of two major newspapers. Reprinted in P.M. Peterson (Ed.) 
Case Studies in International Journal of Sport Communication eBook. Champaign, IL: Human 
Kinetics. 


McGuire, J. & Armfield G. G. (2015). In the beginning: The Rasmussens and the launch of 
ESPN. In J. McGuire, G.G. Armfield, & A.C. Earnheardt (Eds.), The ESPN Effect: Exploring the 
Worldwide Leader in Sports (pp. 3-10). New York: Peter Lang. 


Armfield. G.G., & McGuire, J. (2015). Preface: You’ve come a long way baby. In J. McGuire, 
G.G. Armfield, & A.C. Earnheardt (Eds.), The ESPN Effect: Exploring the Worldwide Leader in 
Sports (pp. xiv-xviii). New York: Peter Lang. 


Peer-Reviewed Articles 


Nduka, E.L., & McGuire, J. (2017). The effective use of new media in disseminating evangelical 
messages among Catholic students. Journal of Media and Religion, 16(3), 93-102. 


Armfield, G.A., & McGuire, J. (2017). Peddling the truth or coasting downhill? Lance 
Armstrong and the use of image repair strategies. The Sports Journal [online]. Available from 
http://thesportjournal.org/article/coasting-downhill-or-peddling uphill-image repair-strategies-of- 
Lance-Armstrong 


Ketterer, S., McGuire, J., & Hoffman, S. (2016). Nate Silver vs. the pundits: Examining the roles 
of political punditry, big data and cognitive dissonance in a 2012 U.S. presidential dispute. 
Southwestern Mass Communication Journal, 32(1). Available from 
http://swecjmc.wp.txstate.edu/files/2017/02/ketterer-mcguire-hoffman.pdf 


Overby, K., & McGuire, J. (2016). Contrasting male and female sports announcers during 
NCAA tournament games. Journal of Sports Media, 11(2), 87-109. 


Craig Freeman, 
Associate Professor 
Director (2015-present) 


Books 


Goidel, K., Freeman, C. and Smentkowski, B. (2015). Misreading the Bill of Rights: Top Ten 
Myths Concerning Your Rights and Liberties. Praeger: Santa Barbara. 


Refereed Publications 


Goidel, K., Smentkowski, B., & Freeman, C. (2016). Perceptions of Threat to Religious Liberty. 
PS: Political Science & Politics, 49(03), 426-432. 


Professional Publications 


Goidel, K., Smentkowski, B., Freeman, C. (2017, January 30). “Claiming Voter Fraud to Limit 
Voter Turnout.” Huffington Post. 


Freeman, C. & Goidel, K. (2017, January 27). “How Journalists Should Act in the Age of 
Alternative Facts.” Huffington Post. 


Jack Hodgson, 
Associate Professor 


Conference Presentation 
“US-Central Asia Educational Initiatives and Media Exchanges: a Personal Experience,” Part of 


a panel discussion, “‘Post-Independence Media in Central Asia: Realities, Hopes, Achievements.” 
Central Eurasia Study Society annual conference, Princeton University, 6 November 2016. 


Stan Ketterer, 
Associate Professor 


Peer-Reviewed Articles 


Ketterer, S., McGuire, & Murray, R. (2019) “The price of outsourcing: A content analysis of the 
effects of early deadlines on the sports section of The Oklahoman’ is scheduled for publication 
in the Winter 2019 edition of the Newspaper Research Journal. 


Craig, D., Ketterer, S., & Mohammed, Y. (2017) To post or not to post: Ethical considerations in 
using gun permit data online. Journalism and Mass Communication Quarterly 94.1: 168- 
188. (Top journal in our field.) 


Ketterer, S., McGuire, J. & Hoffman, S. (2016) Nate Silver vs. the pundits: Examining the roles 
of political punditry, Big Data and cognitive dissonance in a 2012 U.S. presidential election 
dispute. Southwestern Mass Communication Journal, Fall 2016 (V. 32, No. 1). Available from 
http://swecjmc.wp.txstate.edu/fall-2016/ 





McGuire, J., Murray, R., & Ketterer, S. (2015). Sports department vs. news department: Editorial 
control in television newsrooms. The Sport Journal [online]. Available from 

http://thesportjournal. org/article/sports-department-vs-news-department-editorial-control-in- 
television-newsrooms. 








Kian, E.M., Ketterer, S., Nichols, C., & Poling, J. (2014).Watchdogs of the Fourth Estate or 
homer journalists? Small and mid-sized newspaper coverage of local BCS college football 
programs. The Sport Journal. Available at:http://thesportjournal.org/article/watchdogs-of-the- 
fourth-estate-or-homer-journalists-newspaper-coverage-of-local-bcs-college-football-programs. 








Ketterer, S., McGuire, J., and Murray, R. (1 April 2013). Contrasting Desired Sports Journalism 
Skills in a Converged Media Environment. Communication & 
Sport. doi:10.1177/21674795 13482118. 


Peer-Reviewed Conference Papers 


“An Examination of the Attitudes and Practices of Mass Communication Programs 
Regarding Unpaid Student Internships” with Joey Senat and John McGuire was presented at 
the March 2017 at the Midwinter Conference of the Association for Education in Journalism and 
Mass Communication at the University of Oklahoma in Norman. It received the Top Abstract 
Award in the Media Management, Economics & Entrepreneurship Division. 


“The Price of Outsourcing: A Case Study of the Effects of Early Deadlines on the Sports 
Section in The Oklahoman” with John McGuire and Ray Murray was presented at the March 
2017 at the Midwinter Conference of the Association for Education in Journalism and Mass 
Communication at the University of Oklahoma in Norman. 


“To Post or Not to Post: Ethical Considerations in Using Gun Permit Data Online” with 
David Craig and Yousuf Mohammed of the University of Oklahoma was presented in August 
2014 national convention of the Association for Education in Journalism and Mass 
Communication in Toronto. The paper won the Top Faulty Paper Award in the Media Ethics 
Division. 


“Watchdogs of the Fourth Estate or Homer Journalists? Local Newspaper Coverage of 
Marquee College Football Programs” with Ted Kian, Joey Senat and James Pohling was 
presented in March 2013 at the Midwinter Conference of the Association for Education in 
Journalism and Mass Communication at the University of Oklahoma in Norman. 


Bobbi Kay Lewis, 
Associate Professor 
Assistant Dean (2015-present) 


Books 


Holtzhausen, D., Fullerton, J.A., Lewis, B. H., & Shipka, D. (under contract). Principles of 
Strategic Communications. Thousand Oaks, CA: SAGE Publishing. 


Refereed Publications 


Lewis, B.K. & Nichols, C. (2016). “Social media and strategic communication: A three-year 
study of attitudes and perceptions about social media among college students” Public Relations 
Journal, Vol. 10, No. 1. 


Nichols, C., Lewis, B. K. & Shreves, M.K (2015). “Fatties Get a Room!” An examination of 
humor, imagery, and stereotyping in Mike & Molly. Journal of Entertainment and Media 
Studies, 1(1), 99-126. 


Book Chapters 

Nichols, C. & Lewis, B. K. (2017, March). “An Examination of Prosocial and Antisocial 
Behavior Exhibited through Cyber-bullying and Affirmative Behaviors” In K. Burns (Ed), Social 
Media: A Reference Handbook. ALB-CLIO. 

Lewis, B. K. & Nichols, C. (2014). “Strategic Communication: The role of social media in 
developing community” In D. Holtzhausen & A. Zerfass (Eds.), The Routledge Handbook of 
Strategic Communication (pp. 545-560). New York: Routledge. 


Peer-Reviewed Conference Papers 


“The “They” in Cyberbullying: Examining Empathy and Third-Person Effects in Cyberbullying 
of Young Adults” with Cynthia Nichols presented August 2015 at the Association for Education 
in Journalism and Mass Communication Annual Conference in San Francisco, CA. 


“A Lifetime of Innovation: An Experiment in Educating and Engaging Rural, Urban and 
Underrepresented Children in Science, Technology, Engineering & Math (STEM) Through 
Strategic Communication” with Cynthia Nichols presented March 2015 at the Midwinter 
Conference of the Association for Education in Journalism and Mass Communication at the 
University of Oklahoma in Norman. 


“Social Media and Strategic Communication: A four-year study of attitudes and perceptions 
about social media among college students” with Cynthia Nichols presented March 2014 at the 
Midwinter Conference of the Association for Education in Journalism and Mass Communication 
at the University of Oklahoma in Norman. 


Lori McKinnon, 
Associate Professor 


Refereed Publications 
Kim, K. & McKinnon, L. M. (2018). Framing Financial Advertising: Message Effectiveness in 


Intertemporal Choice. Journal of Marketing Communications, DOI: 
https://do1.org/10.1080/13527266.2018.1476400. 








Nichols, C., McKinnon, L.M., & Geary, A. (2016). Rumor Has It: Examining the Effects of 
Facebook Addiction on Political Knowledge Gullibility. The Journal of Social Media in Society, 
5 (1), 229-264. 





Fullerton, J. A. & McKinnon, L. M. (2015). U.S. Public Relation Students’ Perceptions of PR: 
What College Students Think About PR Education and the PR Profession. Public Relations 
Journal, 9(2), http://www.prsa.org/Intelligence/PRJournal/Vol9/No2/ 











Fullerton, J., McKinnon, L. M. & Kendrick, A. (2014). A Comparison of Advertising and Public 
Relation Students on Ethics: Attitudes and Predicted Behavior. Southwestern Mass 
Communications Journal, 30(2). 








McKinnon, L. M. & Fullerton, J. (2014). Public Relations Students’ Ethics: An Examination of 
Attitude and Intended Behaviors. Teaching PR Monographs, 90, 
hhtp://www.aejmc.us/PR/tpr/tpr90su14.pdf. 





Fullerton, J. A. and McKinnon, L. M. (2014). What college students think about PR Education 
and the PR Profession. Public Relations Review, Research in Brief. 





Fullerton, J. A., Kendrick, A., and McKinnon, L. M. (2013). Advertising Ethics: Student 
Attitudes and Behavioral Intent. Journalism and Mass Communication Educator, 68(1), 33-48, 
DOI: http://dx.doi.org/10.1177/10776958 12472894. 








Invited Book Chapters and Contributions 





Fullerton, J. A., Kendrick, A., & McKinnon, L. M. (2018), Public Relations’ Students Media 
Literacy: A Multi-Measure Examination of Attitudes and Aptitudes. Completed chapter for 
inclusion in the forthcoming book on Fake News to fulfill required collaterals for the Page 
Legacy Scholar Grant. 





McKinnon, L. M. & Nichols, C. (2015). Ch. 7: Measurement in De. Sloan and S. Zhu (Eds.), 
Research Methods in Mass Communication, 2™ ed., pp. 93-106. Tuscaloosa, AL: Vision Press. 





Convention Presentations 


Kim, K. & McKinnon, L. M. (2016, August). Framing Financial Retirement Advertising: The 
Effectiveness of Intertemporal Choice. Paper presented at the annual meeting of the Association 
for Education in Journalism and Mass Communication, Minneapolis, MN. 








Raymond Murray, 
Associate Professor 


Peer-Reviewed Publications 


Ketterer, S., McGuire, J. & Murray, R., The Price of Outsourcing: A Content Analysis of the 
Effects of Early Deadlines on the Sports Sections in The Oklahoman, Newspaper Research 
Journal, Winter 2019 40 (1). 


McGuire, J., & Murray, R., New Work Demands Create Inequality for Sports Journalists, 
Newspaper Research Journal, Winter 2016 37(1), pp. 58-69; doi: 10.1177/07395329 16634648 


Kian, E.M., Anderson, E., Vincent, J., & Murray, R. (2015). Sport journalists’ views on gay men 
in sport, society and within sport media. International Review for the Sociology of Sport, 50(8), 
895-911. Advanced online publication. October 2, 2013: doi: 10.1177/1012690213504101. 
Published by Sage. One of top three sport sociology journals. 2012 impact factor of 1.341. 


McGuire, J., Murray. R., & Ketterer, S. (2015). Sports department vs. news department: Editorial 
control in television newsrooms. The Sports Journal. 


Kian, E.M., & Murray, R. (2014). Curmudgeons but yet adapters: Impact of Web 2.0 and Twitter 
on newspaper sport journalists’ jobs, responsibilities, and routines. #ISOJ (the official, refereed 
journal of the International Symposium for Online Journalism), 4(1), 61-77. 


* This research led to an external article on the study published by the Nieman Journalism Lab at 
Harvard University. 


Murray, R. (2013) Keeping the Paparazzi and Arm’s Length Away. The Journal of Popular 
Culture, 6(4), pp. 868-885. Impact factor of .063. 


Ketterer, S., McGuire, J., & Murray, R. (2013). Contrasting Desired Sports Journalism Skills in a 
Convergent Media Environment. Communication & Sport. 1-17. 
DOI:10.1177/21674795 13482118 


McGuire, J., & Murray, R. (2013). Attitudes of Sport Print Journalists about Developing 
Electronic Media Skills: A Case Study of Two Major Newspapers. International Journal of 
Sport Communication. 6 464-477 


Book Chapter 


John McGuire and Ray Murray (2016). Attitudes of Sport Print Journalists About Developing 
Electronic Media Skills: A Case Study of Two Major Newspapers. Reprinted in P.M. Pedersen 
(Ed.), Case Studies in International Journal of Sport Communication eBook. Champaign, IL: 
Human Kinetics. 


Book Chapter Contribution 


Edward Kian, Bradley Schultz, Galen Clavio and Mary Lou Sheffer (2018). Multimedia Sports 
Journalism; A Practitioner's Guide for the Digital Age. Oxford University Press. Contributed to 
Chapter 5. 


Cynthia Nichols, 


Associate Professor (2013 — 2017) 
Accepted/Published Journal Entries 


Lewis, B. K. & Nichols, C. (2016). Social media and strategic communication: A three-year 
study of attitudes and perceptions about social media among college students. Public Relations 
Review, 10 (1), 1-25. Available at http://www.prsa.org/Intelligence/PRJournal/past- 
editions/Vol10/No1/Lewis.pdf. 








Nichols, C., McKinnon, L. & Geary, A. (2016). Rumor has it: Examining the effects of 
Facebook Addiction on Political Knowledge and Rumor Gullibility. Journal of Social Media in 
Society, 5(1), 229-264. 


Garcia, A. & Nichols, C. (2016). The Effect of Acculturation on the Language of Advertising 
Among Hispanics. Hispanic Journal of Behavioral Sciences, 39, 1-21. 


Murray, C. & Nichols, C. (2015). The Case Study for Hip Hop Music and Children’s 
Educational Television Viewing. Journal of Hip Hop Studies, 2(1), 38-64. 


Nichols, C., Lewis, B. K., & Shreves, M.K. (2015). “Fatties Get a Room!” An examination of 
humor, imagery, and stereotyping in Mike & Molly. Journal of Entertainment and Media 
Studies. 1(1), 99-126. 


Kian, E.M., Ketterer, S., Nichols, C., & Poling, J. (2014). Watchdogs of the Fourth Estate or 
homer journalists? Small and mid-sized newspaper coverage of local BCS college football 
programs. The Sport Journal, Vol. 17, first published online March 10, 2014. Available at: 
http://thesportjournal.org/article/watchdogs-of-the-fourth-estate-or-homer-journalists-newspaper- 
coverage-of-local-bcs-college-football-programs 








Accepted/Published Book Chapters 


McKinnon, L. & Nichols, C. (2015). Chapter 7: Measurement. In S. Zhou & W. D. Sloan (Eds.), 
Research Methods in Communication, 3“ ed. (pp 93-106). Northport, AL: Vision Press 


Nichols, C. & McKenzie, C. T. (2014). Celebrity persuasion in the political arena: A study of 
message effects on voter opinion. In J Zenor (Ed), Parasocial Politics: Audience Readings of 
Cultural Politics in Pop Culture (pp 45-62), Lanham, MD: Lexington. 

Lewis, B. K. & Nichols, C. (2014). “Strategic Communication: The role of social media in 
developing community” In D. Holtzhausen & A. Zerfass (Eds.), The Routledge Handbook of 
Strategic Communication (pp. 545-560). New York: Routledge. 

Accepted/Published Invited Articles 


Nichols, C. (2014). Cases & Commentaries: Responsibility Thwarted. Journal of Mass Media 
Ethics, 29, 273-294. 


Joey Senat, 
Associate Professor 


Books 
Senat, J. (2018) Our Right to Know in Oklahoma. Stillwater, OK: New Forums Press. 


Senat, J. (9" ed. 2018) Mass Communication Law in Oklahoma. Stillwater, OK: New Forums 
Press (previous editions in 2016, 2014, 2007, 2005, 2003, August 2002 and January 2002). 


Book Chapter 


Joey Senat, Public Access and Informational Privacy in Electronic Government Databases, in 
Transparency 2.0, 36-50 (Charles Davis and David Cuillier, eds., Peter Lang Press, 2014). 


Refereed Journal Article 


Senat, J. Whose Business Is It: Is Public Business Conducted on Officials’ Personal Electronic 
Devices Subject to State Open Records Laws? 19(3) Comme’n L. & Pol’y 293-326 (Summer 
2014). 


Invited Articles for Professional Publications 
FOI in Indian Country, Quill: A Magazine by the Society of Professional Journalists 
(July/August 2015, Vol. 103, No. 4): 36. 


Clarifying the Clery Act on campus crime, Quill: A Magazine by the Society of Professional 
Journalists (May/June 2013, Vol. 101, No. 3): 27. 


Open Records & Open Meeting acts ‘for the public,’ Guest Blog, NonDoc, March 18, 2016, 
http://nondoc.com/2016/03/18/open-records-open-meeting-acts-for-the-public/. 





OSU wisely avoids Open Records Act violation, The Daily O'Collegian (Stillwater, Okla.), April 
29, 2013, at 4 (Opinion Page). 


Policy would force faculty lawsuits, The Daily O'Collegian (Stillwater, Okla.), Feb. 11, 2013, at 
4 (Opinion Page). 


Refereed Paper Presentations 
Senat, J., Ketterer, S. & McGuire, J. An Examination of the Attitudes and Practices of Mass 


Communication Programs Regarding Unpaid Student Internships, AEJMC Midwinter, Norman, 
Okla.: March 4, 2017. 


Daniel Shipka, 
Associate Professor 


Books 


Shipka, Danny, and Ralph Beliveau ed: Global Terror: International Horror Film Directors. 
Intellect Press. Distribution University of Chicago Press. Dec. 2016 


Book Chapters 


Shipka, Danny. Public Relations. In Communicating across Disciplines. Ed. Bryan Carr. 
Kendall Hunt Publishing. Feb. 2016 


Journal Articles 


McElroy, Kathleen and Shipka, Danny. I Give the Civil Rights 4-Stars: Film Critics and the Re- 
imagining of the Civil Rights Movement. Journalism Practices Routledge. New York. 11, Nov. 
2015 


Kian, Ted., Anderson, E., & Shipka, Danny. ‘I am happy to start the conversation’: Examining 
sport media framing of Jason Collins’s coming out. Sexualities. Jan. 27, 2015 


Refereed Conference Papers and Panels 


Shipka, Danny. The “Deplorables” of the 1970’s: George Romeo and The Crazies. Popular 
Culture Association conference. Accepted for March 2018 


Trent, Amber Rae and Shipka, Danny. Modernist Interpretations of the Nazi Regime via 
German Film. AEJMC Midwinter. March 2016 


McElroy, Katherine and Shipka, Danny, I Give the Civil Rights 4-Stars: Film Critics and the 
Re-imagining of the Civil Rights Movement. AEJMC, San Francisco. Aug. 2015 


Shipka, Danny. The Day the Grindhouse Died: The Shift from Public Viewing to Private 
Pleasure, AEJMC Midwinter. March 2015 


Shipka, Danny. Opening the World: How to Inspire Rural Students to Learn Abroad. Panel 
Presentation. Hawaii International Conference on Arts & Humanities. Honolulu Hawaii, January 
2014 


Shipka, Danny and Steve Smethers. I Did it Myself: Pinterest and the Evolution of DIY 
Communities. AEJMC Conference. Washington DC, August 2013 


Clara Mikyeung Bae, 
Assistant Professor (August 2017 — Present) 


Peer-Reviewed Journal Articles 


Bae, M. (in press) Attention grabbing power of branded vs. unbranded packaging. Journal of 
Promotion Management. 


Bae, M. (2018) Influences of identified victim images on processing fluency. Journal of 
Nonprofit & Public Sector Marketing. Published online. 


Bae, M. (2018) Overcoming skepticism toward cause-related marketing claims: The role of 
consumers’ attribution and a temporary state of skepticism. Journal of Consumer Marketing, 
35(2), 194-207. 


Bae, M. (2018) Understanding the effect of the discrepancy between sought and obtained 
gratification on social networking site users' satisfaction and continuance intention. Computers in 
Human Behavior, 79, 137-153. 


Bae, M. (2017) Matching cause-related marketing (CRM) campaign to culture: The moderating 
role of information processing style and skepticism. Asian Journal of Communication. Published 
online. 


Peer-Reviewed Conference Papers 


Bae, M. (2019). The impact of message concreteness and level of mental construal on consumer 
response to cause-related marketing claims. American Academy of Advertising (AAA), Dallas, 
TX. 


Batala, B., Bae, M., & Miao, L. (2019). Visual attention on menu: The role of familiarity and 
food neophobia. Graduate Conference in Tourism and Hospitality, Houston, TX. 


Bae, M., Behe, B. K. (2017). Influences of identified victim images on processing fluency. 
International Association of Packaging Research Institutes (APRI), Lausanne, Switzerland. 


Asya Cooley, 
Lecturer (August 2017 — December 2018) 
Assistant Professor (January 2019 — Present) 


Peer-Reviewed Journal Articles 


Cooley, A.B. (2017). Educational Philanthropy: What are the Predictors? Journal of Education 
Advancement and Marketing, 2(1), 46-56. 


Cooley, A.B. (2017). Examining Development of E-government in Russia and China: A 
Comparative Approach. International Journal of Public Administration, 1-10. 


Peer-Reviewed Conference Presentations 


Loehwing, M., Cooley, S.C., Shoup, B., & Cooley, A.B. (2018, November). Teaching Public 
Deliberation through Role-Playing Games. Short course presented at the National 
Communication Association (NCA) Annual Convention, Salt Lake City, UT. 


Cooley, A.B. (2018, September). Who Does it Best? Towards Understanding Virtual 
Accountability in Public, Nonprofit and Private Organizations. Paper presented at the 
Southeastern Conference for Public Administration (SECoPA), Birmingham, AL. 


Cooley, A.B. (2017, October). Facing the Blank Canvas: Towards the Ideal and Pragmatic 
Models of State. Paper presented at the Southeastern Conference for Public Administration 
(SECoPA), Hollywood, FL. 


Cooley, A.B. (2017, October). Public and Nonprofit Work Motivation: Exploring Intrinsic- 
Extrinsic Dichotomy. Paper presented at the Southeastern Conference for Public Administration 
(SECoPA), Hollywood, FL. 


Research Grant 


Co-PI, Department of Homeland Security, Strategic Multi-Layer Assessment, “Global Narratives 
on the Future of Competition & Conflict: A Media Ecology and Strategic Assessment.” $90,000 
(November 2018-August 2019). 


Skye Cooley, 
Assistant Professor (August 2017 — Present) 


Research Support 


Co-PI, Department of Homeland Security, “Motivations & Perspectives of Northern Triangle 
Migration to the United States: Narrative Analysis of Central American Media.” $32,643 
(January 2019-June 2019) 


PI, Department of Homeland Security, Strategic Multi-Layer Assessment, “Global Narratives on 
the Future of Competition & Conflict: A Media Ecology and Strategic Assessment.” $90,000 
(November 2018-August 2019). 


Co-PI, Department of Homeland Security, Strategic Multi-Layer Assessment, “Global Media 
Monitoring on DPRK and Afghanistan.” $65,000 (July 2018-June 2019). 


Co-PI, Department of Homeland Security, Strategic Multi-Layer Assessment, “Global Media 
Messages about Space.” $48,358 (August 2017-May 2018). 


Peer-Review Journal Articles 
Kluver, R., Cooley, S.C., & Hinck, R. (2018). Contesting strategic narratives in a global context: 


The world watches the 2016 U.S. election. International Journal of Press/Politics, July, 1-23. 
https://doi.org/10.1177/1940161218786426 





Hinck, R., Kluver, R. & Cooley, S.C. (2018). Russia re-envisions the world: strategic narratives 
in Russian broadcast and news media during 2015. Russian Journal of Communication, 10(1), 
21-37. https://doi.org/10.1080/19409419.2017.1421096 





Cooley, S. C., and Stokes, E. C. (2018). Manufacturing resilience: An analysis of broadcast and 
web-based news presentations of the 2014-2015 Russian economic downturn. Global Media and 
Communication, 14(1), 123-139. 


Damm, E., & Cooley, S.C. (2017). Resurrection of the Russian Orthodox Church: Narrative 
analysis of the Russian national myth. Social Science Quarterly, 98(3), 942-957. 


Academic Conference Presentations 


Cooley, S.C., Loehwing, M., & Shoup, B. (2018). Deliberative Play: Developing Civic Trust and 
Communicative Abilities through Collaborative Gaming. Political Communication Division. 
National Communication Association 104th Annual Convention. November 9-11. Salt Lake City, 
Utah. 


Loehwing, M., Cooley, S.C., Cooley, A., Shoup, B. (2018). Sc19: Teaching Public Deliberation 


through Role-Playing Games. Short Courses. National Communication Association 104th 
Annual Convention. November 9-11. Salt Lake City, Utah. 


Jared Johnson, 
Assistant Professor (August 2014 — Present) 


Refereed Journal Articles 


Johnson, J. L. (in press). News Consumption in the case of the Garifuna people: 
Reaching the audience or not?. Electronic News Journal. 


Johnson, J. L. (2015). Media in the Margins: The Garifuna Response to Social Media. 
Journal of Social Media in Society 


Johnson, J. L., & West, A. (2015). Local programming trends in Chile: Does 
programming meet audience demands? International Communication Research Journal. 


Johnson, J. L., & Callahan, C. (2013). Minority cultures and social media: Magnifying 
Garifuna. Journal of Intercultural Communication. 


Academic Book Chapters 


Johnson, J.L. (in press). Creation of The Longhorn Network: Shadow of a Dying 
Business Model. The ESPN Aftereffect and the Changing Sports Media Marketplace. 


Peer-Reviewed Creative Works 
Johnson, J.L. (2017). “The Dream Investment.” This is a long-form journalism 


piece/documentary about Emmanuel Ogbah, and athlete from Nigeria whose motto has 
been to keep clean, stay out of trouble and work hard. It is an example that this type of 


effort is an investment into an athlete’s future. It follows Ogbah through training for the 
2016 NFL Draft, resulting in his selection in the second round. 


Conference Presentations 


Armfield, G., McGuire, J., Murray, R., & Johnson, J. (2018, April). A framing analysis of NFL 
draft coverage: Which position has the most intelligent athletes according to media personalities? 
Presented at the 11th Summit on Communication and Sport, Bloomington, IN. 


Randle, Q., Johnson, J. (2018) “Prosodic elements for content delivery in 
broadcast journalism: A quantitative study of vocal pitch. Presented at National 
Communication Association. Currently revising for publication in Electronic News. 


Kenneth Kim, 
Assistant Professor (2013-2014) 


Refereed Journals: 


Park. J., Ju, I., & Kim, K. E. (2013). Direct-to-consumer antidepressant advertising and 
consumers’ optimistic bias about the future risk of depression: The moderating role of 
advertising skepticism. Health Communication. 


Convention Papers: 


Kim, K. E. & Kim, C. (2013). “An Experimental Investigation of News Frames and the Hostile 
Media Effect.” Paper presented to Journalism Studies Division at the annual conference of the 
International Communication Association, London, UK, June 17 — 21, 2013 


Kim, K. E., & McGuire, J. (2013). “The Hostile Media Phenomenon: Sports Fanship and 
Perceptions of Sports Media Bias.” Paper presented at the Summit on Communication and Sport, 
Austin, TX, February 22 — 23, 2013 (Distinguished Paper) 


Kim, C., & Kim, K. E. (2013). “The Role of Emotions in the Hostile Media Effect: Testing the 
Mediation Function of Emotions.” Paper presented for presentation to Political communication 
Division at the annual conference of the International Communication Association, London, UK, 
June 17 — 21, 2013 


Kathleen McElroy, 
Assistant Professor (2014-2015) 


Academic Peer-Reviewed Publications 


McElroy, K. (2015). Remembering Mayberry in white and black: The Andy Griffith Show’s 
construction of the South. Memory Studies 8(4). 


McElroy, K. (2015). Gold medals, Black Twitter and Not-so-good hair: Framing the Gabby 
Douglas controversy. #ISOJ Journal. 


McElroy, K. (2014). “Basket Case”: Framing the intersection of Linsanity and Blackness. 
Howard Journal of Communications, 25 (4). Published online, October 22, 2014. 


Academic Peer-Reviewed Papers and Presentations 


McElroy, K. (2015). Gold medals, Black Twitter and Not-so-good hair: Framing the Gabby 
Douglas controversy. ISOJ Conference. Austin, Texas. 


Coleman, R., Lee, J.Y., Yashur, A., Meader, A., & McElroy, K. (2014). Why be a journalist? 
Students’ motivations and role conceptions in the new age of journalism. 2014 Laurence R. 
Campbell Research Award for Top Faculty Paper, 2014 Association for Education in Journalism 
and Mass Communication Conference, Montreal. 


McElroy, K. & Hilton, A. (2014). “Black Girls in Search of (140) Characters.” Panelists: What it 
Means to be a Woman Online, Sixteenth Biennial Rhetoric Society of America Conference, San 
Antonio. 


McElroy, K. (2013). “Basket Case”: Framing Linsanity and Blackness,” Third place, student 
paper award, Minorities and Communication Division. 2013 Association for Education in 
Journalism and Mass Communication Conference, Washington. 


McElroy, K. & Lee, N.Y. (2013). “Are Online Comments Good for You? Health Journalism and 


Its Readers.” Communicating Science, Health Environment and Risk Division. 2013 AEJMC 
Conference, Washington. 


Hillary Speed, 
Assistant Professor of Professional Practice 


Published Work 


“In Western North Carolina: Do Go Chasing Waterfalls,” Associated Press, June 25, 2018 





“Back to School: busy season for networks of online shoppers,” Associated Press, Aug. 10, 2015 





“8 Rules Every Grandparent Should Learn,” WhatToExpect.com June 23, 2015 





“What They REALLY Need to Invent for Babies, According to a Baby,” WhatToExpect.com 
June 15, 2015 





“The Children’s Menu to Beat All Children’s Menus,” WhatToExpect.com May 4, 2015 





“15 Mommy Milestones They Don’t Tell You About,” WhatToExpect.com, Dec. 16, 2014 
(2,000 shares) 





“Why Your Due Date Is Great,” WhatToExpect.com, May 29, 2014 





“Grieving moms create living tributes to their children,” Associated Press, Nov. 19, 2013 





“Great creative with place cards, escort cards,” Associated Press, June 26, 2013 





“Travel spotlight: Tulsa, Oklahoma’s art deco style, music and more,” Associated Press, March 
4, 2013 





Max Andrews, 
Lecturer (August 2016 — Present) 


Conference Presentation 

“A La Carte Cable Pricing and the Future of Broadcast Television, “ invited presentation to 
Broadcast Education Association at the National Association of Broadcasters, Las Vegas, NV, 
April 2016. Placed second in national competition. 
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Appendix 6-2 - Advising Notes 


Advising Notes for SMSC Students 


Definitions and Other Notes 





TLA/BUS/GE - UPPER -DIVISION (3000-4000 level) 


TLA = Traditional Liberal Arts (From the College of Arts & Sciences) 
AMST, ART, ASL, BIOL, BOT, CS, DANC, ECON, ENGL, FLL, UD Foreign Language, GEOG, GEOL, 
GWST, HIST, MATH, MICR, MUSI, PBIO, PHIL, PHYS, POLS, PSYC, REL, SOC, STAT, TH, ZOOL 





BUS = Business (From the Spears School of Business) 
BADM, BCOM, EEE, FIN, LSB, MGMT, MKTG, MSIS 





GE = Gen Ed (General Education) - Gen Eds are classes with designations such as (A), (N), (H), (D), 
(I), (S). Any upper-division Gen Ed course can be used in this area except SMSC classes (MC, MM], 
SC & SPM). Gen Ed classes can be found (under Attributes) using the Advanced Search Option in 
Banner Self-Service. 








Any Arts or (H) in College/Dept Requirements: 


Arts and Humanities are defined as any course carrying an (H) designation or courses from AMST, 
ART, DANC, ENGL (except ENGL 3323) HIST, MUSI, PHIL (except PHIL 1313 Logic and Critical 
Thinking (A), PHIL 3003 (A) and PHIL 4003), REL, TH, and foreign languages. 


Any (N) Science or (A) Math in College/Dept Requirements: 


Natural and Mathematical Sciences are defined as any course from the following prefixes: ASTR, 
BIOC, BIOL, CHEM, CS (except CS 4883), GEOL, MATH, MICR, PBIO, PHYS, and STAT; or courses 
from other departments that carry an (A) or (N) general education designation. 


Any (L) Scientific Investigation: This is the “Lab” requirement. Some Natural Science (N) 
courses carry the (L) designation and some do not. All students must have at least one (L) to 
graduate. These can be found using the Advanced Search Option in Banner Self-Service/Attributes. 
Search under “Scientific Investigation”. 


Upper-Division Gen Eds (A)(N)(H)(D)(1)(S): A&S students need two 3000 or 4000 


level gen eds (six credit hours) somewhere on their degree sheet. This may not include courses from 
MC, MMJ, SC OR SPM. 


Non-Western Requirement (BAs Only): Non-Western Studies Requirement for B.A.; 
One 3-hour course in Non-Western Studies (N.W.). This requirement may be satisfied by a course 
also used to satisfy any other part of a student's degree program (i.e, in General Education, 
College/Dept. or Major Requirements or Electives). Non-Western courses can be found using the 
Advanced Search Option in Banner Self-Service. Search under Attributes, 


STAT must be completed BEFORE SC 3953 / MM] 4393 (research class). 





Other Notes: 


GPA Requirements: All courses from SMSC (MC, MMJ, SC and SPM) must be a C or better to 
count towards graduation. Additionally, students must have a combined 2.5 or better GPA in all 
major area requirements. 


Course Descriptions Including Prerequisites: 


Course Listings from OSU's Course Catalog: http://catalog.okstate.edu/courses/ 
Also, course descriptions and prerequisites can be found in Banner Self-Service. 





Enrollment Guides: 


This includes enrollment dates, important dates and deadlines and final exam schedule, 
https://registrar.okstate.edu/Registration-and-Enrollment 





MORE: 


A minimum of 72 hours must be taken outside of MC-MMJ-SC-SPM. No more than 12 hours in MC- 
MMJ-SC-SPM can be transferred from other institutions. 


Students are required to develop and maintain a portfolio exhibiting specific and appropriate work 
including required class assignments 


Total hours must include at least 40 hours in courses numbered 3000 or above. Additionally, at least 
60 hours must be from a four-year institution. 


Hours in SMSC in excess of 48 will be added to the minimum total of 120 required for graduation. 
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322 Seudent Union TRIAL STUDY SEMESTER: [ 1Spring { ]Summer [ jFall YEAR: 20 


StiPwater, Oklahoma 24078-2078 
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regisvee@ubsiateedu 
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Dear Phillip, 


Thank you for your support of our School. Your support sends a 
powerful message demonstrating your commitment to our students 
and our mission. 


We have been busy in the JB this year. We just launched a daily live 
newscast. Our students continue to earn top honors in national 
competitions. Faculty members use cutting edge tools to advance 
their research and challenge our students. 


I truly appreciate your support for OSU and wish you the best in the 
upcoming year. If you’re close to campus, please stop by so we can 
thank you in person. Should you have any questions about our 
school, my number is (405) 744-7676. 


Loyal & True, 


Craig Freeman 
Director, School of Media & Strategic Communication 


























Séicrico 
WONS PILS 





Warmest wishes on your special day! 
Happy Birthday! 


School of Media & Strategic Communications 


























Appendix 9-1 - Assessment Plan 


School of Media & Strategic Communications 
2016-17 Assessment Plan 
Bachelor of Arts in Multimedia Journalism 
by Bobbi Kay Lewis, Associate Director of Undergraduate Studies 
submitted March 1, 2016 
APPROVED BY FACULTY SEPTEMBER 20, 2019 


Introduction 

The School of Media and Strategic Communications (SMSC) at Oklahoma State 
University has a proud tradition of preparing students for successful careers 
and for providing them with a well-rounded foundation of skills and 
appreciation for the importance of mass communication in American society. 
SMSC student learning goals are in line with the 12 professional values and 
competencies as suggested by the accrediting Council on Education in 
Journalism and Mass Communication (ACEJMC). SMSC consolidated the 12 
values and competencies into eight learning outcomes titled the O-State 8, 


Mission 

To educate the future leaders in mass communication from Oklahoma, its 
neighboring states, the nation and the world to be responsible and effective 
communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and 
embracing change through lifelong learning. Oklahoma State University School 
of Media and Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

. Appreciation for the liberal arts 
. Adaptability 

. Problem solving skills 

Diversity 

. Leadership 

. Community involvement 


Wonavpawns 


Student Learning Outcomes 


ACEJMC Professional Values and Competencies 

The Accrediting Council on Education in Journalism and Mass Communications 
requires that, irrespective of their particular specialization, all graduates should 
be aware of certain core values and competencies and be able to: 


1. 


p N 


11. 
12. 


Understand and apply the principles and laws of freedom of speech and 
press for the country in which the institution that invites ACEJMC is 
located, as well as receive instruction in and understand the range of 
systems of freedom of expression around the world, including the right 
to dissent, to monitor and criticize power, and to assemble and petition 
for redress of grievances; 

Demonstrate an understanding of the history and role of professionals 
and institutions in shaping communications; 

Demonstrate an understanding of gender, race, ethnicity, sexual 
orientation and, as appropriate, other forms of diversity in domestic 
society in relation to mass communications; 


. Demonstrate an understanding of the diversity of peoples and cultures 


and of the significance and impact of mass communications in a global 
society; 

Understand concepts and apply theories in the use and presentation of 
images and information; 


. Demonstrate an understanding of professional ethical principles and 


work ethically in pursuit of truth, accuracy, fairness and diversity; 
Think critically, creatively and independently; 


. Conduct research and evaluate information by methods appropriate to 


the communications professions in which they work; 


. Write correctly and clearly in forms and styles appropriate for the 


communications professions, audiences and purposes they serve; 


. Critically evaluate their own work and that of others for accuracy and 


fairness, clarity, appropriate style and grammatical correctness; 

Apply basic numerical and statistical concepts; 

Apply current tools and technologies appropriate for the 
communications professions in which they work, and to understand the 
digital world. 


Student Learning Outcomes “The O-State 8” 

1. Students demonstrate an understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role of 
mass communications. 

4. Students demonstrate critical, creative and individual thinking, 

5. Students demonstrate an understanding of the relevant theories and 
concepts of mass communications. 

6. Students demonstrate an understanding of the methods and techniques 
of research, information and news gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in multimedia journalism. 

8. Students demonstrate an understanding of relevant planning and 
management methods in multimedia journalism. 


Direct and Indirect Measures 


Direct Measure #1: Core Competencies Test 

In order to measure student learning outcomes in the core curriculum of all 3 
degree programs in SMSC, a test was developed to be administered to 
incoming sophomores taking SC 2003 Media Style & Structure and to 
outgoing/graduating seniors in their senior capstone course, 


The test includes 50 multiple-choice questions grouped into categories based 
on the professional values and competencies required by the Accrediting 
Council for Education in Journalism and Mass Communication and the O-State 
8 learning outcomes. The questions and learning outcomes covered on this 
test will be covered in the following 5 core courses that students in all 3 majors 
are required to complete: 

MC 1143 Media in a Diverse Society 

MC 2003 Mass Media Style & Structure 

MC 2023 Electronic Communication 

MC 4143 Ethics and Issues in Mass Communication 

MC 4163 Mass Communication Law 


The percentage of the two groups answering each of the 50 questions 
correctly will be computed. In addition, the percentage of the two groups 
answering each question correctly in each category will also be calculated to 
compare results for each competency. 


The purpose of the Core Competencies Test is to establish a reasonable 
benchmark for student achievement of the different areas by the time 
students graduate. In addition, the test will determine whether (and by what 
percentage) the outgoing/graduating seniors score higher on average than the 
incoming/sophomores group. 


SMSC will start administering the Core Competencies Test in the respective 
courses in Fall 2016-Spring 2017 semesters. Analysis will be conducted on an 
academic calendar basis, and results will be compared over time. 


Competency Categories 
1. Truth, accuracy and fairness 
Freedom of speech and the press 
Ethical ways of thinking 
History and role of media in society’ 
Diversity of audiences in a global age 
. Application of theories 
Understand data and statistics 
Understand planning and management methods 


oN ayAWN 


The following O-State 8 learning outcomes will be assessed by this measure: 


1. Students demonstrate an understanding of the relevant 
constitutional freedoms, legal issues and ethical principles in mass 
communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role 
of mass communications. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of mass communications. 

8. Students demonstrate an understanding of relevant planning and 
management methods in multimedia journalism. 


Direct Measure #2: Capstone Projects/Portfolios 

The school offers a Multimedia Journalism capstone course, which is a 
culmination and integration of the courses throughout the degree program. 
Students complete an online portfolio with artifacts created throughout the 
program and submit the portfolio to the instructor as part of their capstone 
class. The artifacts available on the online portfolios of graduated students will 
be used to assess the learning outcomes. The links to graduated students’ 
electronic portfolios will be entered into a spreadsheet. Ten percent of the 
Spring 2016 portfolios will be selected using the online randomizing tool, 
Randomizer. External reviewers (media professionals) will be asked to assess 
the online portfolios based on the assessment rubric. 


The following O-State 8 learning outcomes will be assessed by this measure: 


4. Students demonstrate critical, creative and individual thinking. 
6. Students demonstrate an understanding of the methods and 
techniques of research, information and news gathering. 
7. Students demonstrate appropriate writing, editing and production 
techniques in multimedia journalism. 


The assessment values are the same for all learning outcomes. The following 
scale will be used to assess the learning outcomes: 


1= No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 


Indirect Measure #1: Internship Evaluation 

Students in SMSC are strongly encouraged to earn 3 hours of credit through a 
professional internship. As part of the internship process, students and their 
supervisors are asked to complete an evaluation form that includes an 
assessment of ACEJMC’s 12 values and competencies. 


Students are asked to rate their internship experience within the context of the 
learning outcomes/competencies (listed below) using the scale (shown below) 
by indicating the degree to which they believe they were able to do the 


following as a result of the internship (“I can do XXX”). 


The following learning outcomes/competencies will be assessed by this measure: 


1. Understands the tools and technology required to get assigned tasks 
completed. 

2. Practices professional and ethical principles. 

3. Demonstrates an understanding of the role of the profession in society. 

4. Demonstrates respect for colleagues of different ethnic and cultural 
backgrounds. 

5. Presents data, text, and images in a professional manner. 

6. Writes correctly and clearly. 

7. Critically evaluates their own work and others’ to ensure quality work. 

8. Conducts research and is able t evaluate information. 

9. Solves problems creatively and resourcefully. 


Learning outcomes/competencies are rated based on the following scale: 
o = Not Applicable 
1= No or Poor representation of competency 
2 = Somewhat poor representation of competency 
3 = Average representation of competency 
4 = Good representation of competency 
5 = Outstanding representation of competency 


Indirect Measure #2: Alumni Survey 

The purpose of the survey is to examine recent graduates’ perceptions of how 
well SMSC is preparing graduates for today’s jobs in communications. The 
survey will be disseminated to all SMSC graduates from 2012, 2013 and 2014. 
These recent graduates most recently entered the job market and have the 
most recent recollections of what they were taught while attending OSU. 


Indirect Measure #3: Senior Exit Interviews 

We ask graduating seniors to visit with the associate director of undergraduate 
studies toward the end of the spring semester. Embedded in this discussion are 
direct questions concerning the learning outcomes, in which students are 
asked to rank their perception of how well they might be able to discuss each 


topic. Students are randomly selected and asked to participate in the 
interviews. Participation in the exit interview is not required, but we tend to 
get a good representation of students and a good insight into their perceptions 
of how well we cover each outcome when taken as part of the overall 
evaluation process. Approximately 8 MMJ students will be interviewed. 


Analysis and Use of the Results 


Upon completion of the yearly Departmental Assessment Report, trends in the 
assessments will be investigated by the departmental curriculum committee. 
Thus, specific areas of weakness can be identified. Based on these trends, 
proposals for adjustments in the curriculum will be made by the curriculum 
committee. The committee will present the results of the assessment and the 
proposed curriculum adjustments to the faculty for discussion on a yearly basis 
in Faculty meetings, leading to votes on specific plans for adjustments to the 
curriculum when needed. 


As aresult of assessment efforts, we have recently changed the way we offer 
some of courses to put more focus and faculty attention to training our 
students to be better writers. Specifically, MC 2003 Mass Media Style & 
Structure was changed to be taught as lecture/lab combination with faculty 
teaching 20 students per section, rather than a large lecture course with 
separate lab sections taught by teaching assistants. 


This new plan is an update of past successful assessment methods, as well as 
an addition of new methods. We are currently planning to make more 
curricular adjustments based on feedback from professionals analyzing 
portfolios and internships. 


School of Media & Strategic Communications 
2016-17 Assessment Plan 
Bachelor of Science in Multimedia Journalism 
by Bobbi Kay Lewis, Associate Director of Undergraduate Studies 
submitted March 1, 2016 
APPROVED BY FACULTY SEPTEMBER 20, 2019 

Introduction 
The School of Media and Strategic Communications (SMSC) at Oklahoma State 
University has a proud tradition of preparing students for successful careers 
and for providing them with a well-rounded foundation of skills and 
appreciation for the importance of mass communication in American society. 
SMSC student learning goals are in line with the 12 professional values and 
competencies as suggested by the accrediting Council on Education in 
Journalism and Mass Communication (ACEJMC). SMSC consolidated the 12 
values and competencies into eight learning outcomes titled the O-State 8. 


Mission 

To educate the future leaders in mass communication from Oklahoma, its 
neighboring states, the nation and the world to be responsible and effective 
communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and 
embracing change through lifelong learning. Oklahoma State University School 
of Media and Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

. Appreciation for the liberal arts 
Adaptability 

. Problem solving skills 

Diversity 

. Leadership 

. Community involvement 


Con auypawn a 


Student Learning Outcomes 


ACEJMC Professional Values and Competencies 

The Accrediting Council on Education in Journalism and Mass Communications 
requires that, irrespective of their particular specialization, all graduates should 
be aware of certain core values and competencies and be able to: 


1. 


11. 
12. 


Understand and apply the principles and laws of freedom of speech and 
press for the country in which the institution that invites ACEJMC is 
located, as well as receive instruction in and understand the range of 
systems of freedom of expression around the world, including the right 
to dissent, to monitor and criticize power, and to assemble and petition 
for redress of grievances; 

Demonstrate an understanding of the history and role of professionals 
and institutions in shaping communications; 


. Demonstrate an understanding of gender, race, ethnicity, sexual 


orientation and, as appropriate, other forms of diversity in domestic 
society in relation to mass communications; 


. Demonstrate an understanding of the diversity of peoples and cultures 


and of the significance and impact of mass communications in a global 
society; 

Understand concepts and apply theories in the use and presentation of 
images and information; 


. Demonstrate an understanding of professional ethical principles and 


work ethically in pursuit of truth, accuracy, fairness and diversity; 
Think critically, creatively and independently; 


. Conduct research and evaluate information by methods appropriate to 


the communications professions in which they work; 


. Write correctly and clearly in forms and styles appropriate for the 


communications professions, audiences and purposes they serve; 


„Critically evaluate their own work and that of others for accuracy and 


fairness, clarity, appropriate style and grammatical correctness; 

Apply basic numerical and statistical concepts; 

Apply current tools and technologies appropriate for the 
communications professions in which they work, and to understand the 
digital world. 


Student Learning Outcomes “The O-State 8” 

1. Students demonstrate an understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role of 
mass communications. 

4. Students demonstrate critical, creative and individual thinking. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of mass communications. 

6, Students demonstrate an understanding of the methods and techniques 
of research, information and news gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in multimedia journalism. 

8. Students demonstrate an understanding of relevant planning and 
management methods in multimedia journalism. 


Direct and Indirect Measures 


Direct Measure #1: Core Competencies Test 

In order to measure student learning outcomes in the core curriculum of all 3 
degree programs in SMSC, a test was developed to be administered to 
incoming sophomores taking SC 2003 Media Style & Structure and to 
outgoing/graduating seniors in their senior capstone course. 


The test includes 50 multiple-choice questions grouped into categories based 
on the professional values and competencies required by the Accrediting 
Council for Education in Journalism and Mass Communication and the O-State 
8 learning outcomes. The questions and learning outcomes covered on this 
test will be covered in the following 5 core courses that students in all 3 majors 
are required to complete: 

MC 1143 Media in a Diverse Society 

MC 2003 Mass Media Style & Structure 

MC 2023 Electronic Communication 

MC 4143 Ethics and Issues in Mass Communication 

MC 4163 Mass Communication Law 


The percentage of the two groups answering each of the 50 questions 
correctly will be computed. In addition, the percentage of the two groups 
answering each question correctly in each category will also be calculated to 
compare results for each competency. 


The purpose of the Core Competencies Test is to establish a reasonable 
benchmark for student achievement of the different areas by the time 
students graduate. In addition, the test will determine whether (and by what 
percentage) the outgoing/graduating seniors score higher on average than the 
incoming/sophomores group. 


SMSC will start administering the Core Competencies Test in the respective 
courses in Fall 2016-Spring 2017 semesters. Analysis will be conducted on an 
academic calendar basis, and results will be compared over time. 


Competency Categories 
1. Truth, accuracy and fairness 
Freedom of speech and the press 
Ethical ways of thinking 
. History and role of media in society’ 
Diversity of audiences in a global age 
Application of theories 
Understand data and statistics 
Understand planning and management methods 
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The following O-State 8 learning outcomes will be-assessed by this measure: 


1. Students demonstrate an understanding of the relevant 
constitutional freedoms, legal issues and ethical principles in mass 
communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role 
of mass communications, 

5. Students demonstrate an understanding of the relevant theories and 
concepts of mass communications. 

8. Students demonstrate an understanding of relevant planning and 
management methods in multimedia journalism. 


Direct Measure #2: Capstone Projects/Portfolios 

The school offers a Multimedia Journalism capstone course, which is a 
culmination and integration of the courses throughout the degree program. 
Students complete an online portfolio with artifacts created throughout the 
program and submit the portfolio to the instructor as part of their capstone 
class. The artifacts available on the online portfolios of graduated students will 
be used to assess the learning outcomes. The links to graduated students’ 
electronic portfolios will be entered into a spreadsheet. Ten percent of the 
Spring 2016 portfolios will be selected using the online randomizing tool, 
Randomizer. External reviewers (media professionals) will be asked to assess 
the online portfolios based on the assessment rubric. 


The following O-State 8 learning outcomes will be assessed by this measure: 


4. Students demonstrate critical, creative and individual thinking. 
6. Students demonstrate an understanding of the methods and 
techniques of research, information and news gathering. 
7. Students demonstrate appropriate writing, editing and production 
techniques in multimedia journalism. 


The assessment values are the same for all learning outcomes. The following 
scale will be used to assess the learning outcomes: 


1= No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 


indirect Measure #1: Internship Evaluation 

Students in SMSC are strongly encouraged to earn 3 hours of credit through a 
professional internship. As part of the internship process, students and their 
supervisors are asked to complete an evaluation form that includes an 
assessment of ACEJMC’s 12 values and competencies. 


Students are asked to rate their internship experience within the context of the 
learning outcomes/competencies (listed below) using the scale (shown below) 
by indicating the degree to which they believe they were able to do the 


following as a result of the internship (“I can do XXX”). 


The following learning outcomes/competencies will be assessed by this measure: 


1. Understands the tools and technology required to get assigned tasks 
completed. 

2. Practices professional and ethical principles. 

3. Demonstrates an understanding of the role of the profession in society. 

4. Demonstrates respect for colleagues of different ethnic and cultural 

backgrounds. 

Presents data, text, and images in a professional manner. 

. Writes correctly and clearly, 

Critically evaluates their own work and others’ to ensure quality work. 

. Conducts research and is able t evaluate information. 

. Solves problems creatively and resourcefully. 


we onan 


Learning outcomes/competencies are rated based on the following scale: 
o = Not Applicable 
1= No or Poor representation of competency 
2 = Somewhat poor representation of competency 
3 = Average representation of competency 
4 = Good representation of competency 
5 = Outstanding representation of competency 


Indirect Measure #2: Alumni Survey 

The purpose of the survey is to examine recent graduates’ perceptions of how 
well SMSC is preparing graduates for today’s jobs in communications. The 
survey will be disseminated to all SMSC graduates from 2012, 2013 and 2014. 
These recent graduates most recently entered the job market and have the 
most recent recollections of what they were taught while attending OSU. 


Indirect Measure #3: Senior Exit Interviews 

We ask graduating seniors to visit with the associate director of undergraduate 
studies toward the end of the spring semester. Embedded in this discussion are 
direct questions concerning the learning outcomes, in which students are 
asked to rank their perception of how well they might be able to discuss each 


topic. Students are randomly selected and asked to participate in the 
interviews. Participation in the exit interview is not required, but we tend to 
get a good representation of students and a good insight into their perceptions 
of how well we cover each outcome when taken as part of the overall 
evaluation process. Approximately 8 MMJ students will be interviewed. 


Analysis and Use of the Results 


Upon completion of the yearly Departmental Assessment Report, trends in the 
assessments will be investigated by the departmental curriculum committee. 
Thus, specific areas of weakness can be identified. Based on these trends, 
proposals for adjustments in the curriculum will be made by the curriculum 
committee. The committee will present the results of the assessment and the 
proposed curriculum adjustments to the faculty for discussion on a yearly basis 
in Faculty meetings, leading to votes on specific plans for adjustments to the 
curriculum when needed. 


As a result of assessment efforts, we have recently changed the way we offer 
some of courses to put more focus and faculty attention to training our 
students to be better writers. Specifically, MC 2003 Mass Media Style & 
Structure was changed to be taught as lecture/lab combination with faculty 
teaching 20 students per section, rather than a large lecture course with 
separate lab sections taught by teaching assistants. 


This new plan is an update of past successful assessment methods, as well as 
an addition of new methods. We are currently planning to make more 
curricular adjustments based on feedback from professionals analyzing 
portfolios and internships. 


School of Media & Strategic Communications 
2016-17 Assessment Plan 


Bachelor of Arts in Sports Media 
by Bobbi Kay Lewis, Associate Director of Undergraduate Studies 
submitted March 1, 2016 
APPROVED BY FACULTY SEPTEMBER 20, 2019 


Introduction 

The School of Media and Strategic Communications (SMSC) at Oklahoma State 
University has a proud tradition of preparing students for successful careers 
and for providing them with a well-rounded foundation of skills and 
appreciation for the importance of mass communication in American society. 
SMSC student learning goals are in line with the 12 professional values and 
competencies as suggested by the accrediting Council on Education in 
Journalism and Mass. Communication (ACEJMC). SMSC consolidated the 12 
values and competencies into eight learning outcomes titled the O-State 8. 


Mission 

To educate the future leaders in mass communication from Oklahoma, its 
neighboring states, the nation and the world to be responsible and effective 
communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and 
embracing change through lifelong learning. Oklahoma State University School 
of Media and Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

. Problem solving skills 

Diversity 

. Leadership 

- Community involvement 
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Student Learning Outcomes 


ACEJMC Professional Values and Competencies 

The Accrediting Council on Education in Journalism and Mass Communications 
requires that, irrespective of their particular specialization, all graduates should 
be aware of certain core values and competencies and be able to: 


1. 


co N 


11. 
12. 


Understand and apply the principles and laws of freedom of speech and 
press for the country in which the institution that invites ACEJMC is 
located, as well as receive instruction in and understand the range of 
systems of freedom of expression around the world, including the right 
to dissent, to monitor and criticize power, and to assemble and petition 
for redress of grievances; 

Demonstrate an understanding of the history and role of professionals 
and institutions in shaping communications; 

Demonstrate an understanding of gender, race, ethnicity, sexual 
orientation and, as appropriate, other forms of diversity in domestic 
society in relation to mass communications; 


. Demonstrate an understanding of the diversity of peoples and cultures 


and of the significance and impact of mass communications in a global 
society; 

Understand concepts and apply theories in the use and presentation of 
images and information; 


. Demonstrate an understanding of professional ethical principles and 


work ethically in pursuit of truth, accuracy, fairness and diversity; 
Think critically, creatively and independently; 


. Conduct research and evaluate information by methods appropriate to 


the communications professions in which they work; 


. Write correctly and clearly in forms and styles appropriate for the 


communications professions, audiences and purposes they serve; 


. Critically evaluate their own work and that of others for accuracy and 


fairness, clarity, appropriate style and grammatical correctness; 

Apply basic numerical and statistical concepts; 

Apply current tools and technologies appropriate for the 
communications professions in which they work, and to understand the 
digital world. 





Student Learning Outcomes “The O-State 8” 

1, Students demonstrate an understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role of 
mass communications and sports media. 

4. Students demonstrate critical, creative and individual thinking. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of sports media. 

6. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in sports media. 

8. Students demonstrate an understanding of relevant planning and 
management methods in sports media. 


Direct and Indirect Measures 


Direct Measure #1: Core Competencies Test 

In order to measure student learning outcomes in the core curriculum of all 3 
degree programs in SMSC, a test was developed to be administered to 
incoming sophomores taking SC 2003 Media Style & Structure and to 
outgoing/graduating seniors in their senior capstone course. 


The test includes 50 multiple-choice questions grouped into categories based 
on the professional values and competencies required by the Accrediting 
Council for Education in Journalism and Mass Communication and the O-State 
8 learning outcomes. The questions and learning outcomes covered on this 
test will be covered in the following 5 core courses that students in all 3 majors 
are required to complete: 

MC 1143 Media in a Diverse Society 

MC 2003 Mass Media Style & Structure 

MC 2023 Electronic Communication 

MC 4143 Ethics and Issues in Mass Communication 

MC 4163 Mass Communication Law 


The percentage of the two groups answering each of the 50 questions 
correctly will be computed. In addition, the percentage of the two groups 
answering each question correctly in each category will also be calculated to 
compare results for each competency. 


The purpose of the Core Competencies Test is to establish a reasonable 
benchmark for student achievement of the different areas by the time 
students graduate. In addition, the test will determine whether (and by what 
percentage) the outgoing/graduating seniors score higher on average than the 
incoming/sophomores group. 


SMSC will start administering the Core Competencies Test in the respective 
courses in Fall 2016-Spring 2017 semesters. Analysis will be conducted on an 
academic calendar basis, and results will be compared over time. 


Competency Categories 
4. Truth, accuracy and fairness 
Freedom of speech and the press 
Ethical ways of thinking 
. History and role of media in society’ 
Diversity of audiences in a global age 
. Application of theories 
Understand data and statistics 
. Understand planning and management methods 
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The following O-State 8 learning outcomes will be assessed by this measure: 


1. Students demonstrate an understanding of the relevant 
constitutional freedoms, legal issues and ethical principles in mass 
communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role 
of mass communications and sports media. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of mass sports media. 

8. Students demonstrate an understanding of relevant planning and 
management methods in sports media. 


Direct Measure #2: Capstone Projects/Portfolios 

The school offers a Sports Media capstone course, which is a culmination and 
integration of the courses throughout the degree program. culmination and 
integration of the courses throughout the degree program. Students complete 
an online portfolio with artifacts created throughout the program and submit 
the portfolio to the instructor as part of their capstone class. The artifacts 
available on the online portfolios of graduated students will be used to assess 
the learning outcomes, The links to graduated students’ electronic portfolios 
will be entered into a spreadsheet. Ten percent of the Spring 2016 portfolios 
will be selected using the online randomizing tool, Randomizer. External 
reviewers (sports media professionals) will be asked to assess the online 
portfolios based on the assessment rubric. 
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The following O-State 8 learning outcomes will be assessed by this measure: 


4. Students demonstrate critical, creative and individual thinking, 

6. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in sports media. 


The assessment values are the same for all learning outcomes. The following 
scale will be used to assess the learning outcomes: 


1= No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 


Indirect Measure #1: Internship Evaluation 

Students in SMSC are strongly encouraged to earn 3 hours of credit through a 
professional internship. As part of the internship process, students and their 
supervisors are asked to complete an evaluation form that includes an 
assessment of ACEJMC’s 12 values and competencies. 


- Students are asked to rate their internship experience within the context of the 
learning outcomes/competencies (listed below) using the scale (shown below) 


by indicating the degree to which they believe they were able to do the 
following as a result of the internship (“1 can do XXX”). 
The following learning outcomes/competencies will be assessed by this measure: 


4, Understands the tools and technology required to get assigned tasks 
completed. 

2. Practices professional and ethical principles. 

3. Demonstrates an understanding of the role of the profession in society. 

4. Demonstrates respect for colleagues of different ethnic and cultural 
backgrounds. 

5. Presents data, text, and images in a professional manner. 

6. Writes correctly and clearly. 

7. Critically evaluates their own work and others’ to ensure quality work. 

8. Conducts research and is able t evaluate information. 

9. Solves problems creatively and resourcefully. 


Learning outcomes/competencies are rated based on the following scale: 
o = Not Applicable 
1= No or Poor representation of competency 
2 = Somewhat poor representation of competency 
3 = Average representation of competency 
4 = Good representation of competency 
5 = Outstanding representation of competency 


Indirect Measure #2: Alumni Survey 

The purpose of the survey is to examine recent graduates’ perceptions of how 
well SMSC is preparing graduates for today’s jobs in communications. The 
survey will be disseminated to all SMSC graduates from 2012, 2013 and 2014. 
These recent graduates most recently entered the job market and have the 
most recent recollections of what they were taught while attending OSU. 


Indirect Measure #3: Senior Exit Interviews 

We ask graduating seniors to visit with the associate director of undergraduate 
studies toward the end of the spring semester. Embedded in this discussion are 
direct questions concerning the learning outcomes, in which students are 


asked to rank their perception of how well they might be able to discuss each 
topic. Students are randomly selected and asked to participate in the 
interviews. Participation in the exit interview is not required, but we tend to 
get a good representation of students and a good insight into their perceptions 
of how well we cover each outcome when taken as part of the overall 
evaluation process. Approximately 8 sports media students will be interviewed. 


Analysis and Use of the Results 


Upon completion of the yearly Departmental Assessment Report, trends in the 
assessments will be investigated by the departmental curriculum committee. 
Thus, specific areas of weakness can be identified. Based on these trends, 
proposals for adjustments in the curriculum will be made by the curriculum 
committee. The committee will present the results of the assessment and the 
proposed curriculum adjustments to the faculty for discussion ona yearly basis 
in Faculty meetings, leading to votes on specific plans for adjustments to the 
curriculum when needed. 


As a result of assessment efforts, we have recently changed the way we offer 
some of courses to put more focus and faculty attention to training our 
students to be better writers. Specifically, MC 2003 Mass Media Style & 
Structure was changed to be taught as lecture/lab combination with faculty 
teaching 20 students per section, rather than a large lecture course with 
separate lab sections taught by teaching assistants. 


This new plan is an update of past successful assessment methods, as well as 
an addition of new methods. We are currently planning to make more 
curricular adjustments based on feedback from professionals analyzing 
portfolios and internships. 
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Bachelor of Science in Sports Media 
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Introduction 

The School of Media and Strategic Communications (SMSC) at Oklahoma State 
University has a proud tradition of preparing students for successful careers 
and for providing them with a well-rounded foundation of skills and 
appreciation for the importance of mass communication in American society. 
SMSC student learning goals are in line with the 12 professional values and 
competencies as suggested by the accrediting Council on Education in 
Journalism and Mass Communication (ACEJMC). SMSC consolidated the 12 
values and competencies into eight learning outcomes titled the O-State 8. 


Mission 

To educate the future leaders in mass communication from Oklahoma, its 
neighboring states, the nation and the world to be responsible and effective 
communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and 
embracing change through lifelong learning. Oklahoma State University School 
of Media and Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

. Problem solving skills 

Diversity 

. Leadership 

. Community involvement 
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Student Learning Outcomes 


ACEJMC Professional Values and Competencies 

The Accrediting Council on Education in Journalism and Mass Communications 
requires that, irrespective of their particular specialization, all graduates should 
be aware of certain core values and competencies and be able to: 


1. Understand and apply the principles and laws of freedom of speech and 
press for the country in which the institution that invites ACEJMC is 
located, as well as receive instruction in and understand the range of 
systems of freedom of expression around the world, including the right 
to dissent, to monitor and criticize power, and to assemble and petition 
for redress of grievances; 

2. Demonstrate an understanding of the history and role of professionals 
and institutions in shaping communications; 

3. Demonstrate an understanding of gender, race, ethnicity, sexual 
orientation and, as appropriate, other forms of diversity in domestic 
society in relation to mass communications; 

4, Demonstrate an understanding of the diversity of peoples and cultures 
and of the significance and impact of mass communications in a global 
society; 

5. Understand concepts and apply theories in the use and presentation of 
images and information; 

6. Demonstrate an understanding of professional ethical principles and 
work ethically in pursuit of truth, accuracy, fairness and diversity; 

7. Think critically, creatively and independently; 

8. Conduct research and evaluate information by methods appropriate to 
the communications professions in which they work; 

9. Write correctly and clearly in forms and styles appropriate for the 
communications professions, audiences and purposes they serve; 

10. Critically evaluate their own work and that of others for accuracy and 
fairness, clarity, appropriate style and grammatical correctness; 

11. Apply basic numerical and statistical concepts; 

12. Apply current tools and technologies appropriate for the 
communications professions in which they work, and to understand the 
digital world. 


Student Learning Outcomes “The O-State 8” 

1. Students demonstrate an understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role of 
mass communications and sports media. 

4. Students demonstrate critical, creative and individual thinking. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of sports media. . 

6. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in sports media. 

8. Students demonstrate an understanding of relevant planning and 
management methods in sports media. 


Direct and Indirect Measures 


Direct Measure #1: Core Competencies Test 

In order to measure student learning outcomes in the core curriculum of all 3 
degree programs in SMSC, a test was developed to be administered to 
incoming sophomores taking SC 2003 Media Style & Structure and to 
outgoing/graduating seniors in their senior capstone course. 


The test includes 50 multiple-choice questions grouped into categories based 
on the professional values and competencies required by the Accrediting 
Council for Education in Journalism and Mass Communication and the O-State 
8 learning outcomes. The questions and learning outcomes covered on this 
test will be covered in the following 5 core courses that students in all 3 majors 
are required to complete: 

MC 1143 Media in a Diverse Society 

MC 2003 Mass Media Style & Structure 

MC 2023 Electronic Communication 

MC 4143 Ethics and Issues in Mass Communication 

MC 4163 Mass Communication Law 


The percentage of the two groups answering each of the 50 questions 
correctly will be computed. In addition, the percentage of the two groups 
answering each question correctly in each category will also be calculated to 
compare results for each competency. 


The purpose of the Core Competencies Test is to establish a reasonable 
benchmark for student achievement of the different areas by the time 
students graduate, In addition, the test will determine whether (and by what 
percentage) the outgoing/graduating seniors score higher on average than the 
incoming/sophomores group. 


SMSC will start administering the Core Competencies Test in the respective 
courses in Fall 2016-Spring 2017 semesters. Analysis will be conducted on an 
academic calendar basis, and results will be compared over time. 


Competency Categories 
4. Truth, accuracy and fairness 
Freedom of speech and the press 
Ethical ways of thinking 
. History and role of media in society’ 
Diversity of audiences in a global age 
. Application of theories 
Understand data and statistics 
. Understand planning and management methods 
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The following O-State 8 learning outcomes will be assessed by this measure: 


1. Students demonstrate an understanding of the relevant 
constitutional freedoms, legal issues and ethical principles in mass 
communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role 
of mass communications and sports media. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of mass sports media. 

8. Students demonstrate an understanding of relevant planning and 
management methods in sports media. 


Direct Measure #2: Capstone Projects/Portfolios 

The school offers a Sports Media capstone course, which is a culmination and 
integration of the courses throughout the degree program. Students complete 
an online portfolio with artifacts created throughout the program and submit 
the portfolio to the instructor as part of their capstone class. The artifacts 
available on the online portfolios of graduated students will be used to assess 
the learning outcomes. The links to graduated students’ electronic portfolios 
will be entered into a spreadsheet. Ten percent of the Spring 2016 portfolios 
will be selected using the online randomizing tool, Randomizer. External 
reviewers (sports media professionals) will be asked to assess the online 
portfolios based on the assessment rubric. 


The following O-State 8 learning outcomes will be assessed by this measure: 


4. Students demonstrate critical, creative and individual thinking. 

6. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in sports media. 


The assessment values are the same for all learning outcomes. The following 
scale will be used to assess the learning outcomes: 


1= No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 


Indirect Measure #1: Internship Evaluation 

Students in SMSC are strongly encouraged to earn 3 hours of credit through a 
professional internship. As part of the internship process, students and their 
supervisors are asked to complete an evaluation form that includes an 
assessment of ACEJMC’s 12 values and competencies. 


Students are asked to rate their internship experience within the context of the 
learning outcomes/competencies (listed below) using the scale (shown below) 
by indicating the degree to which they believe they were able to do the 


following as a result of the internship (“1 can do XXX”). 
The following learning outcomes/competencies will be assessed by this measure: 


1. Understands the tools and technology required to get assigned tasks 
completed. 

2. Practices professional and ethical principles. 

3. Demonstrates an understanding of the role of the profession in society. 

4. Demonstrates respect for colleagues of different ethnic and cultural 
backgrounds. 

5. Presents data, text, and images in a professional manner. 

6. Writes correctly and clearly. 

7. Critically evaluates their own work and others’ to ensure quality work. 

8. Conducts research and is able t evaluate information. 

9. Solves problems creatively and resourcefully. 


Learning outcomes/competencies are rated based on the following scale: 
o = Not Applicable 
1= No or Poor representation of competency 
2 = Somewhat poor representation of competency 
3 = Average representation of competency 
4 = Good representation of competency 
5 = Outstanding representation of competency 


Indirect Measure #2: Alumni Survey 

The purpose of the survey is to examine recent graduates’ perceptions of how 
well SMSC is preparing graduates for today’s jobs in communications, The 
survey will be disseminated to all SMSC graduates from 2012, 2013 and 2014. 
These recent graduates most recently entered the job market and have the 
most recent recollections of what they were taught while attending OSU. 


Indirect Measure #3: Senior Exit Interviews 

We ask graduating seniors to visit with the associate director of undergraduate 
studies toward the end of the spring semester. Embedded in this discussion are 
direct questions concerning the learning outcomes, in which students are 
asked to rank their perception of how well they might be able to discuss each 


topic. Students are randomly selected and asked to participate in the 
interviews. Participation in the exit interview is not required, but we tend to 
get a good representation of students and a good insight into their perceptions 
of how well we cover each outcome when taken as part of the overall 
evaluation process. Approximately 8 sports media students will be interviewed. 


Analysis and Use of the Results 


Upon completion of the yearly Departmental Assessment Report, trends in the 
assessments will be investigated by the departmental curriculum committee. 
Thus, specific areas of weakness can be identified. Based on these trends, 
proposals for adjustments in the curriculum will be made by the curriculum 
committee. The committee will present the results of the assessment and the 
proposed curriculum adjustments to the faculty for discussion on a yearly basis 
in Faculty meetings, leading to votes on specific plans for adjustments to the 
curriculum when needed. 


As aresult of assessment efforts, we have recently changed the way we offer 
some of courses to put more focus and faculty attention to training our 
students to be better writers. Specifically, MC 2003 Mass Media Style & 
Structure was changed to be taught as lecture/lab combination with faculty 
teaching 20 students per section, rather than a large lecture course with 
separate lab sections taught by teaching assistants. 


This new plan is an update of past successful assessment methods, as well as 
an addition of new methods. We are currently planning to make more 
curricular adjustments based on feedback from professionals analyzing 
portfolios and internships. | 


School of Media & Strategic Communications 
2016-17 Assessment Plan 


Bachelor of Arts in Strategic Communications 
by Bobbi Kay Lewis, Associate Director of Undergraduate Studies 
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Introduction 

The School of Media and Strategic Communications (SMSC) at Oklahoma State 
University has a proud tradition of preparing students for successful careers 
and for providing them with a well-rounded foundation of skills and 
appreciation for the importance of mass communication in American society. 
SMSC student learning goals are in line with the 12 professional values and 
competencies as suggested by the accrediting Council on Education in 
Journalism and Mass Communication (ACEJMC). SMSC consolidated the 12 
values and competencies into eight learning outcomes titled the O-State 8. 


Mission 

To educate the future leaders in mass communication from Oklahoma, its 
neighboring states, the nation and the world to be responsible and effective 

- communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and 
embracing change through lifelong learning. Oklahoma State University School 
of Media and Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

. Appreciation for the liberal arts 
Adaptability 

. Problem solving skills 

Diversity 

. Leadership 

, Community involvement 
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Student Learning Outcomes 


ACEJMC Professional Values and Competencies 

The Accrediting Council on Education in Journalism and Mass Communications 
requires that, irrespective of their particular specialization, all graduates should 
be aware of certain core values and competencies and be able to: 


Fe 


10. 


Understand and apply the principles and laws of freedom of speech and 
press for the country in which the institution that invites ACEJMC is 
located, as well as receive instruction in and understand the range of 
systems of freedom of expression around the world, including the right 
to dissent, to monitor and criticize power, and to assemble and petition 
for redress of grievances; 


. Demonstrate an understanding of the history and role of professionals 


and institutions in shaping communications; 

Demonstrate an understanding of gender, race, ethnicity, sexual 
orientation and, as appropriate, other forms of diversity in domestic 
society in relation to mass communications; 


. Demonstrate an understanding of the diversity of peoples and cultures 


and of the significance and impact of mass communications in a global 
society; 

Understand concepts and apply theories in the use and presentation of 
images and information; 


. Demonstrate an understanding of professional ethical principles and 


work ethically in pursuit of truth, accuracy, fairness and diversity; 
Think critically, creatively and independently; 


. Conduct research and evaluate information by methods appropriate to 


the communications professions in which they work; 


. Write correctly and clearly in forms and styles appropriate for the 


communications professions, audiences and purposes they serve; 
Critically evaluate their own work and that of others for accuracy and 
fairness, clarity, appropriate style and grammatical correctness; 


. Apply basic numerical and statistical concepts; 
. Apply current tools and technologies appropriate for the 


communications professions in which they work, and to understand the 
digital world. 


Student Learning Outcomes “The O-State 8” 

1. Students demonstrate an understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role of 
mass communications. 

4. Students demonstrate critical, creative and individual thinking. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of strategic communications, 

6. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 

7. Students demonstrate appropriate writing, editing and production 
techniques in strategic communications, 

8. Students demonstrate an understanding of relevant planning and 
management methods in strategic communications. 


Direct and Indirect Measures 


Direct Measure #1: Core Competencies Test 

In order to measure student learning outcomes in the core curriculum of all 3 
degree programs in SMSC, a test was developed to be administered to 
incoming sophomores taking SC 2003 Media Style & Structure and to 
outgoing/graduating seniors in their senior capstone course. 


The test includes 50 multiple-choice questions grouped into categories based 
on the professional values and competencies required by the Accrediting 
Council for Education in Journalism and Mass Communication and the O-State 
8 learning outcomes. The questions and learning outcomes covered on this 
test will be covered in the following 5 core courses that students in all 3 majors 
are required to complete: 

MC 1143 Media in a Diverse Society 

MC 2003 Mass Media Style & Structure 

MC 2023 Electronic Communication 

MC 4143 Ethics and Issues in Mass Communication 

MC 4163 Mass Communication Law 


The percentage of the two groups answering each of the 50 questions 
correctly will be computed. In addition, the percentage of the two groups 
answering each question correctly in each category will also be calculated to 
compare results for each competency. 


The purpose of the Core Competencies Test is to establish a reasonable 
benchmark for student achievement of the different areas by the time 
students graduate. In addition, the test will determine whether (and by what 
percentage) the outgoing/graduating seniors score higher on average than the 
incoming/sophomores group. 


SMSC will start administering the Core Competencies Test in the respective 
courses in Fall 2016-Spring 2017 semesters. Analysis will be conducted on an 
academic calendar basis, and results will be compared over time. 


Competency Categories 
14. Truth, accuracy and fairness 
. Freedom of speech and the press 
. Ethical ways of thinking 
. History and role of media in society’ 
Diversity of audiences in a global age 
. Application of theories 
Understand data and statistics 
. Understand planning and management methods 
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The following O-State 8 learning outcomes will be assessed by this measure: 


1. Students demonstrate an understanding of the relevant 
constitutional freedoms, legal issues and ethical principles in mass 
communication, 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role 
of mass communications. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of strategic communications. 

8. Students demonstrate an understanding of relevant planning and 
management methods in strategic communications, 


Direct Measure #2: Capstone Projects/Portfolios 

The school offers a Strategic Communications capstone course, which is a 
culmination and integration of the courses throughout the degree program. 
Students complete an online portfolio with artifacts created throughout the 
program and submit the portfolio to the instructor as part of their capstone 
class. The artifacts available on the online portfolios of graduated students will 
be used to assess the learning outcomes. The links to graduated students’ 
electronic portfolios will be entered into a spreadsheet. Ten percent of the 
Spring 2016 portfolios will be selected using the online randomizing tool, 
Randomizer. External reviewers (media professionals) will be asked to assess 
the online portfolios based on the assessment rubric. 


The following O-State 8 learning outcomes will be assessed by this measure: 


4, Students demonstrate critical, creative and individual thinking. 

6. Students demonstrate an understanding of the relevant theories and 
concepts of strategic communications. 

7. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 


The assessment values are the same for all learning outcomes. The following 
scale will be used to assess the learning outcomes: 


1 = No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 


Indirect Measure #1: Internship Evaluation 

Students in SMSC are strongly encouraged to earn 3 hours of credit through a 
professional internship. As part of the internship process, students and their 
supervisors are asked to complete an evaluation form that includes an 
assessment of ACEJMC’s 12 values and competencies. 


Students are asked to rate their internship experience within the context of the 
learning outcomes/competencies (listed below) using the scale (shown below) 
by indicating the degree to which they believe they were able to do the 
following as a result of the internship (“1 can do XXX”). 


The following learning outcomes/competencies will be assessed by this measure; 


4, Understands the tools and technology required to get assigned tasks 
completed, 

2. Practices professional and ethical principles. 

3. Demonstrates an understanding of the role of the profession in society. 

4. Demonstrates respect for colleagues of different ethnic and cultural 
backgrounds. 

5. Presents data, text, and images in a professional manner. 

6. Writes correctly and clearly. 

7. Critically evaluates their own work and others’ to ensure quality work. 

8. Conducts research and is able t evaluate information. 

9. Solves problems creatively and resourcefully. 


Learning outcomes/competencies are rated based on the following scale: 
o = Not Applicable 
1= No or Poor representation of competency 
2 = Somewhat poor representation of competency 
3 = Average representation of competency 
4 = Good representation of competency 
5 = Outstanding representation of competency 


Indirect Measure #2: Alumni Survey 

The purpose of the survey is to examine recent graduates’ perceptions of how 
well SMSC is preparing graduates for today’s jobs in communications. The 
survey will be disseminated to all SMSC graduates from 2012, 2013 and 2014. 
These recent graduates most recently entered the job market and have the 
most recent recollections of what they were taught while attending OSU. 


Indirect Measure #3: Senior Exit Interviews 

We ask graduating seniors to visit with the associate director of undergraduate 
studies toward the end of the spring semester. Embedded in this discussion are 
direct questions concerning the learning outcomes, in which students are 
asked to rank their perception of how well they might be able to discuss each 
topic. Students are randomly selected and asked to participate in the 
interviews. Participation in the exit interview is not required, but we tend to 
get a good representation of students and a good insight into their perceptions 
of how well we cover each outcome when taken as part of the overall 
evaluation process. Approximately 10 strategic communications students will 
be interviewed. 


Analysis and Use of the Results 


Upon completion of the yearly Departmental Assessment Report, trends in the 
assessments will be investigated by the departmental curriculum committee. 
Thus, specific areas of weakness can be identified. Based on these trends, 
proposals for adjustments in the curriculum will be made by the curriculum 
committee. The committee will present the results of the assessment and the 
proposed curriculum adjustments to the faculty for discussion on a yearly basis 
in Faculty meetings, leading to votes on specific plans for adjustments to the 
curriculum when needed. 


As a result of assessment efforts, we have recently changed the way we offer 
some of courses to put more focus and faculty attention to training our 
students to be better writers. Specifically, MC 2003 Mass Media Style & 
Structure was changed to be taught as lecture/lab combination with faculty 
teaching 20 students per section, rather than a large lecture course with 
separate lab sections taught by teaching assistants. 


This new plan is an update of past successful assessment methods, as well as 
an addition of new methods. We are currently planning to make more 
curricular adjustments based on feedback from professionals analyzing 
portfolios and internships. 


School of Media & Strategic Communications 
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Introduction 

The School of Media and Strategic Communications (SMSC) at Oklahoma State 
University has a proud tradition of preparing students for successful careers 
and for providing them with a well-rounded foundation of skills and 
appreciation for the importance of mass communication in American society. 
SMSC student learning goals are in line with the 12 professional values and 

` competencies as suggested by the accrediting Council on Education in 
Journalism and Mass Communication (ACEJMC). SMSC consolidated the 12 
values and competencies into eight learning outcomes titled the O-State 8. 


Mission 

To educate the future leaders in mass communication from Oklahoma, its 
neighboring states, the nation and the world to be responsible and effective 
communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and 
embracing change through lifelong learning. Oklahoma State University School 
of Media and Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

. Appreciation for the liberal arts 
Adaptability 

. Problem solving skills 

Diversity 

Leadership 

Community involvement 
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Student Learning Outcomes 


ACEJMC Professional Values and Competencies 

The Accrediting Council on Education in Journalism and Mass Communications 
requires that, irrespective of their particular specialization, all graduates should 
be aware of certain core values and competencies and be able to: 


1, Understand and apply the principles and laws of freedom of speech and 
press for the country in which the institution that invites ACEJMC is 
located, as well as receive instruction in and understand the range of 
systems of freedom of expression around the world, including the right 
to dissent, to monitor and criticize power, and to assemble and petition 
for redress of grievances; 

2. Demonstrate an understanding of the history and role of professionals 
and institutions in shaping communications; 

3. Demonstrate an understanding of gender, race, ethnicity, sexual 
orientation and, as appropriate, other forms of diversity in domestic 
society in relation to mass communications; 

4, Demonstrate an understanding of the diversity of peoples and cultures 
and of the significance and impact of mass communications in a global 
society; 

5. Understand concepts and apply theories in the use and presentation of 
images and information; 

6. Demonstrate an understanding of professional ethical principles and 
work ethically in pursuit of truth, accuracy, fairness and diversity; 

7. Think critically, creatively and independently; 

8. Conduct research and evaluate information by methods appropriate to 
the communications professions in which they work; 

9. Write correctly and clearly in forms and styles appropriate for the 
communications professions, audiences and purposes they serve; 

10. Critically evaluate their own work and that of others for accuracy and 
fairness, clarity, appropriate style and grammatical correctness; 

11. Apply basic numerical and statistical concepts; 

12. Apply current tools and technologies appropriate for the 
communications professions in which they work, and to understand the 
digital world. 


Student Learning Outcomes “The O-State 8” 

4. Students demonstrate an understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass communication. 

2. Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role of 
mass communications. 

4. Students demonstrate critical, creative and individual thinking. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of strategic communications, 

6. Students demonstrate an understanding of the methods and techniques 
of research and information gathering, 

7. Students demonstrate appropriate writing, editing and production 
techniques in strategic communications. 

8. Students demonstrate an understanding of relevant planning and 
management methods in strategic communications. 


Direct and Indirect Measures 


Direct Measure #1: Core Competencies Test 

in order to measure student learning outcomes in the core curriculum of all 3 
degree programs in SMSC, a test was developed to be administered to 
incoming sophomores taking SC 2003 Media Style & Structure and to 
outgoing/graduating seniors in their senior capstone course. 


The test includes 50 multiple-choice questions grouped into categories based 
on the professional values and competencies required by the Accrediting 
Council for Education in Journalism and Mass Communication and the O-State 
8 learning outcomes. The questions and learning outcomes covered on this 
test will be covered in the following 5 core courses that students in all 3 majors 
are required to complete: 

MC 1143 Media in a Diverse Society 

MC 2003 Mass Media Style & Structure 

MC 2023 Electronic Communication 

MC 4143 Ethics and Issues in Mass Communication 

MC 4163 Mass Communication Law 


The percentage of the two groups answering each of the 50 questions 
correctly will be computed. In addition, the percentage of the two groups 
answering each question correctly in each category will also be calculated to 
compare results for each competency. 


The purpose of the Core Competencies Test is to establish a reasonable 
benchmark for student achievement of the different areas by the time 
students graduate. In addition, the test will determine whether (and by what 
percentage) the outgoing/graduating seniors score higher on average than the 
incoming/sophomores group. 


SMSC will start administering the Core Competencies Test in the respective 
courses in Fall 2016-Spring 2017 semesters. Analysis will be conducted on an 
academic calendar basis, and results will be compared over time. 


Competency Categories 
1. Truth, accuracy and fairness 
Freedom of speech and the press 
. Ethical ways of thinking 
History and role of media in society’ 
Diversity of audiences in a global age 
. Application of theories 
Understand data and statistics 
. Understand planning and management methods 


SN AR YN 


The following O-State 8 learning outcomes will be assessed by this measure: 


1. Students demonstrate an understanding of the relevant 
constitutional freedoms, legal issues and ethical principles in mass 
communication. 

2, Students demonstrate an understanding of the relevance of human 
diversity in mass communications. 

3. Students demonstrate an understanding of the history and social role 
of mass communications. 

5. Students demonstrate an understanding of the relevant theories and 
concepts of strategic communications. 

8. Students demonstrate an understanding of relevant planning and 
management methods in strategic communications. 


Direct Measure #2: Capstone Projects/Portfolios 

The school offers a Strategic Communications capstone course, whichis a 
culmination and integration of the courses throughout the degree program. 
Students complete an online portfolio with artifacts created throughout the 
program and submit the portfolio to the instructor as part of their capstone 
class. The artifacts available on the online portfolios of graduated students will 
be used to assess the learning outcomes. The links to graduated students’ 
electronic portfolios will be entered into a spreadsheet. Ten percent of the 
Spring 2016 portfolios will be selected using the online randomizing tool, 
Randomizer. External reviewers (media professionals) will be asked to assess 
the online portfolios based on the assessment rubric. — 


The following O-State 8 learning outcomes will be assessed by this measure: 


4. Students demonstrate critical, creative and individual thinking. 

6. Students demonstrate an understanding of the relevant theories and 
concepts of strategic communications. 

7. Students demonstrate an understanding of the methods and techniques 
of research and information gathering. 


The assessment values are the same for all learning outcomes. The following 
scale will be used to assess the learning outcomes: 


1 = No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 


Indirect Measure #1: Internship Evaluation 

Students in SMSC are strongly encouraged to earn 3 hours of credit through a 
professional internship. As part of the internship process, students and their 
supervisors are asked to complete an evaluation form that includes an 
assessment of ACEJMC’s 12 values and competencies. 


Students are asked to rate their internship experience within the context of the 
learning outcomes/competencies (listed below) using the scale (shown below) 
by indicating the degree to which they believe they were able to do the 
following as a result of the internship (“I can do XXX”). 


The following learning outcomes/competencies will be assessed by this measure; 


1. Understands the tools and technology required to get assigned tasks 
completed. 

2. Practices professional and ethical principles. 

3. Demonstrates an understanding of the role of the profession in society. 

4. Demonstrates respect for colleagues of different ethnic and cultural 
backgrounds. . 

5. Presents data, text, and images in a professional manner. 

6. Writes correctly and clearly. 

7. Critically evaluates their own work and others’ to ensure quality work. 

8. Conducts research and is able t evaluate information. 

9. Solves problems creatively and resourcefully. 


Learning outcomes/competencies are rated based on the following scale: 
o = Not Applicable 
1= No or Poor representation of competency 
2 = Somewhat poor representation of competency 
3 = Average representation of competency 
4 = Good representation of competency 
5 = Outstanding representation of competency 


Indirect Measure #2: Alumni Survey 

The purpose of the survey is to examine recent graduates’ perceptions of how 
well SMSC is preparing graduates for today’s jobs in communications. The 
survey will be disseminated to all SMSC graduates from 2012, 2013 and 2014. 
These recent graduates most recently entered the job market and have the 
most recent recollections of what they were taught while attending OSU. 


Indirect Measure #3: Senior Exit Interviews 

We ask graduating seniors to visit with the associate director of undergraduate 
studies toward the end of the spring semester. Embedded in this discussion are 
direct questions concerning the learning outcomes, in which students are 
asked to rank their perception of how well they might be able to discuss each 
topic. Students are randomly selected and asked to participate in the 
interviews. Participation in the exit interview is not required, but we tend to 
get a good representation of students and a good insight into their perceptions 
of how well we cover each outcome when taken as part of the overall 
evaluation process. Approximately 10 strategic communications students will 
be interviewed. 


Analysis and Use of the Results 


Upon completion of the yearly Departmental Assessment Report, trends in the 
assessments will be investigated by the departmental curriculum committee. 
Thus, specific areas of weakness can be identified. Based on these trends, 
proposals for adjustments in the curriculum will be made by the curriculum 
committee. The committee will present the results of the assessment and the 
proposed curriculum adjustments to the faculty for discussion on a yearly basis 
in Faculty meetings, leading to votes on specific plans for adjustments to the 
curriculum when needed. 


As aresult of assessment efforts, we have recently changed the way we offer 
some of courses to put more focus and faculty attention to training our 
students to be better writers. Specifically, MC 2003 Mass Media Style & 
Structure was changed to be taught as lecture/lab combination with faculty 
teaching 20 students per section, rather than a large lecture course with 
separate lab sections taught by teaching assistants. 


This new plan is an update of past successful assessment methods, as well as 
an addition of new methods. We are currently planning to make more 
curricular adjustments based on feedback from professionals analyzing 
portfolios and internships. 


Appendix 9-2 - Assessment Reports 


2017 - 2018 
Annual Assessment Report 


Bachelor of Arts 
Multimedia Journalism 





DAHANA School of Media & Strategic Communication 
Multimedia Journalism — Bachelor of Arts 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





® 


Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 40 
Number of students graduated in 2017-2018: 12 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Critical thinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

e  Problem-solving skills 

e Diversity 

e Leadership 

e Community involvement 





C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 











D. Student Learning Outcomes 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 





Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2,3,5&8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 


Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 
briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students were asked to rate 
the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey 
C Rating of skills (e.g., rubrics) 
ClAnalysis of written artifacts 


XComprehensive, certification, or 
professional exam(s) 


CoOral presentation 
OCourse project 


OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 


CJBenchmarking 


O Measuring effectiveness relative to 
professional standards 


C Review of thesis/dissertation/ creative 
component 


O Capstone project 
Ointernship 


Interviews 


LlPerformance or jury 

Ovisual collection (photos, videos, etc.) 
OReview of student research 

Clother (please specify): 

Click here to specify. 


Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


* Questions 21 -30 pertain to Mass Communication Law 


e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


X Yes XNo 





Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 


MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 
Average score for all SMSC students who took the pretest: 50 percent 
Average score for MMJ — BA students who took the pretest 21 percent 


Questions measuring Learning Outcome #1: 


Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 
Posttest: 
Average score for all SMSC students who took the posttest: 67 percent 
Average score for MMJ-BA students who took the posttest: 38 percent 


Questions measuring Learning Outcome #1: 


The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 
Senior Exits: 
The average for Learning Outcome #1: 5 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
* Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester KlYearly CJEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey OBenchmarking [1Performance or jury 
CRating of skills (e.g., rubrics) Ll Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 


rofessional standards 
Analysis of written artifacts p C Review of student research 
O Review of thesis/dissertation/ creative 


conpanent COther (please specify): 


Cicomprehensive, certification, or 
prifiessional erami 2 Click here to specify. 
. (Capstone project 

(Oral presentation 


DInternshi 
C)Course project p 


Interviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? XYes LINo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.7 out of 5, which achieves the goal. 
Senior students “agree” they have an understanding of the history and social roles in mass communications. 


What do the results suggest about student achievement of this learning outcome? 


Goal Achieved. 4.7 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
{Each Semester OYearly ClEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 


Fall 2017 & Spring 2018 Pre Test: 
Spring 2018 Post Test: 
Senior Exits: 

Total: 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of 


the learning outcome. 


Assessment Methods 


Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey 
CRating of skills (e.g., rubrics) 
LJAnalysis of written artifacts 


[]Comprehensive, certification, or 
professional exam(s) 


DOral presentation 
C1Course project 


OSatisfaction Survey 


CBenchmarking 


C Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


LlCapstone project 
Olnternship 


ClInterviews 


[Performance or jury 

Ovisual collection (photos, videos, etc.) 
Review of student research 

COther (please specify): 

Click here to specify. \ 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 


xXINo 





Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3; 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits: Goal achieved 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press in a 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

* Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

e Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 


effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
Xl Each Semester XYearly LlEvery other year 








D4) Student Learning Outcome #4: Students will demonstrate critical, creative anid independent thinking ds they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 - Electronic Reporting 

e SC 3353 - Persuasive Writing 

e SC 3363 — Graphic Design 

* SC 3463 — Event Planning 

e SC 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


&lSurvey C Benchmarking OPerformance or jury 

Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
DAnalysis of written artifacts Prefessinnyal Eaa OReview of student research 
[1Comprehensive, certification, or Likeview ahthass/Abseregony cheats (lOther (please specify): 


component 


professional GRAMS Click here to specify. 


CiCapstone project 
OOral presentation P pro 


Olinternshi 
OCourse project 5 


s ; OInterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
e ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

¢ ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

* ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


2. External reviewers each reviewed five portfolios. Reviewers received two links: 
e linkto a student portfolio 
e link to an online survey. 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 


scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes RINO 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 6.2 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3.8 out of 5 Goal achieved 
Internal Portfolio Reviews: 4 out of 5 No goal set during first year 
Internship Evaluations: 6.2 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Results indicate that there was a lack of hard journalism or in-depth reporting in the portfolios. Additional hard-hitting/in-depth 
stories are required in the capstone class. Suggestions include a non-sport news story and perhaps one story that includes an FOIA 


filing. 


Timeline for the Assessment 
XEach Semester Xl Yearly CEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Xl Survey OBenchmarking (Performance or jury 
ORating of skills (e.g., rubrics) CJ Measuring effectiveness relative to OVvisual collection (photos, videos, etc.) 
rofessional standards 
OHAnalysis of written artifacts p CReview of student research 
C Review of thesis/dissertation/ creative 


&lComprehensive, certification, or ClOther (please specify): 


i component 
professional exam(s) 


jec li ere to specify. 
O t roject fi 
CoOral presentation Capstone proj Click h 


Ointernshi 
CCourse project p 


Interviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? XYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.5 out of 5. 





What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 
theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 


Timeline for the Assessment 
Each Semester kl Yearly LlEvery other year 





D6) Student Learning Outcome #6: Students wil! demonstrate an understanding of the methods and techniques oj 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods. All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1, Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2, 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey C1Benchmarking (Performance or jury 
Rating of skills (e.g., rubrics) & Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
XlAnalysis of written artifacts P C)Review of student research 
C Review of thesis/dissertation/ creative 


LlComprehensive, certification, or OOther (please specify): 


; component 
professional exam(s) 


Oc ‘ t Click here to spec fy. 
Oor al pr esentation 


Internshi 
(Course project p 


; OInterviews 
UO Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability gather information (Excel Column H) 

* ifthe student used creativity to gather information (Excel Column !) 

e ifthe student’s work used multiple methods & sources to research (Excel Column J) 

e ifthe student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
e link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes CNo 
External portfolio reviews: Score better than 2017 (2017 average was 3.9 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.2) 





Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.93 out of 5 — Goal achieved 
Internal portfolio reviews: 4 out of 5 - No goal set 
Internship Evaluations: 6.2 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


XJEach Semester XlYearly ClEvery other year 
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D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Portfolios: 
Internships: 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey 
X Rating of skills (e.g., rubrics) 
XlAnalysis of written artifacts 


CL1Comprehensive, certification, or 


OBenchmarking 


O Measuring effectiveness relative to 
professional standards 


C Review of thesis/dissertation/ creative 
component 


Performance or jury 
Xl Visual collection (photos, videos, etc.) 
CO Review of student research 


[Other (please specify): 


professional exam(s) Click here tospectty 


X Capstone project 
OOral presentation p pa 


Internshi 
OCourse project R 


Olnterviews 
CO Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? KYes LINo 


Score better than 2017 (2017 average was 3.8 out of 5) 
No goal set in 2018 
Score better than 2017 (2017 average was 6.6) 


External Portfolio Reviews: 
Internal Portfolio Reviews: 
Internship Evaluations; 


Provide a summary of the results from the assessment of Learning Outcome 7. 
External Portfolio Reviews: 3.4 out of 5 — goal not achieved 

Internal Portfolio Reviews: 4 out of 5—no goal set 

Internship Supervisor Reviews: 6.2 out of 7 — goal not achieved 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester lYearly CEvery other year 





D8) Student Learning Outcome #8: Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 
How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey OBenchmarking Performance or jury 

C Rating of skills (e.g., rubrics) O Measuring effectiveness relative to LVisual collection (photos, videos, etc.) 
OMAnalysis of written artifacts professional sahats OReview of student research 
Ocomprehensive, certification, or Eifevienn nning isentinieny create OOther (please specify): 


š component 
nrofessianal-exsmn(s) Click here to specify. 


CCapstone project 
OoOral presentation accel a 


OInternshi 
OCourse project p 


Interviews 
CSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KYes CINo 
Score 4+ or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 3.75 out of 5 — goal not achieved 


What do the results suggest about student achievement of this learning outcome? 
MMI faculty need to address this Learning Outcome in appropriate classes. Seniors scored this as the lowest Learning Outcome 


Timeline for the Assessment 
Yearly Every other year 
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E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated, 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 


assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8, Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 





Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 





The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 


Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree —1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree -5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5, Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 








Internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 













2. An understanding of the relevance of human diversity in 
mass communications. 













3. An understanding of the history and social role of mass 
communications. 








CO pere 









4. Critical, creative and individual thinking. 









5. An understanding of the relevant theories and concepts of 
mass communications. 









6. An understanding of the methods and techniques of 
research and information gathering. 








7. Appropriate writing, editing and production techniques in mass 
communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Teaming Outconre d 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 

No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


np WN 


The ability to craft innovative solutions to difficult problems. 
No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nak UNE 


The ability to look beyond what is obvious and understand what lies beneath the surface. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


UA WN 


The ability to effectively communicate complex ideas and make them understandable. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nf UNA 
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learning Outconie 6 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


U oe U Ne 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome, 


ok wn 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


ot UU Ne 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Vearming Outconie 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


ob WNP 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome, 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


wm e UNA 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


UvO wW Ne 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


ot WN PR 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Conclusion 


The portfolio is professional and will help the student find employment after graduation 


oP WN 


5 Strongly Agree. 

4 Agree. 

3 Neither agree nor disagree. 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 


25% wy 75% 1G 


Average Grade 


Class Average: bower e 4 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


U ser Sta tistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 


OW 25% Sow 75% 1005% 


Average Grade 


Class Average: 1——- -m 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Science 
Multimedia Journalism 





onfvrritn School of Media & Strategic Communication 
Multimedia Journalism — Bachelor of Science 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





® 


Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 54 
Number of students graduated in 2017-2018: 16 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Critical thinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

e  Problem-solving skills 

e Diversity 

e Leadership 

e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media, Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 








D. Student Learning Outcomes 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 





Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2,3,5&8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 
Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation oj the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 
briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students were asked to rate 
the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey Benchmarking (Performance or jury 


ORating of skills (e.g., rubrics) 
ClAnalysis of written artifacts 


XComprehensive, certification, or 
professional exam(s) 


(Oral presentation 
Course project 


CSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 


O Measuring effectiveness relative to 
professional standards 


C Review of thesis/dissertation/ creative 
component 


LCapstone project 
CInternship 


Klinterviews 


Ovisual collection (photos, videos, etc.) 
OReview of student research 

COther (please specify): 

Click here to specify. 


Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester, All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 


e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


X Yes KINo 





Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 
Average score for all SMSC students who took the pretest: 50 percent 
Average score for MMJ — BS students who took the pretest 21 percent 


Questions measuring Learning Outcome #1: 


Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 
Posttest: 
Average score for all SMSC students who took the posttest: 67 percent 
Average score for MMJ-BS students who took the posttest: 35 percent 


Questions measuring Learning Outcome #1: 


The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 
Senior Exits: 
The average for Learning Outcome #1: 5 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
* Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester xl Yearly ClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking O Performance or jury 


ORating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 


professional standards 


DAnalysis of written artifacts OReview of student research 


C Review of thesis/dissertation/ creative 
CL1comprehensive, certification, or component / / OOther (please specify): 
professional exam(s) k 3 
, Click here to specify. 
r L1Capstone project 
OOral presentation 


OInternshi 
CiCourse project p 


s Interviews 
DSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey, 


Did your department/program faculty have a goal set for this learning outcome? Yes CONo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.7 out of 5, which achieves the goal. 
Senior students “agree” they have an understanding of the history and social roles in mass communications. 


What do the results suggest about student achievement of this learning outcome? 


Goal Achieved. 4.7 out of 5, Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
Each Semester OYearly ClEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of 
the learning outcome. 


Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey C1Benchmarking L Performance or jury 
ORating of skills (e.g., rubrics) O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
rofessional standards 
LJAnalysis of written artifacts p OReview of student research 
OReview of thesis/dissertation/ creative 
OComprehensive, certification, or / / COther (please specify): 
3 component 
professional exam(s) ; : 
: Click here to specify. \ 
j LCapstone project 
(1Oral presentation 
ClInternshi 
OCourse project ẹ 
Olnterviews 


OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? KlYes XINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits: Goal achieved 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press in a 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

e Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
XlEach Semester XlYearly Every other year 





D4) Student Learning Outcome #4: students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 — Electronic Reporting 

e SC 3353 - Persuasive Writing 

e SC 3363 — Graphic Design 

e SC 3463 — Event Planning 

e §C 3953 — Research Methods 

* SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking (Performance or jury 

XlRating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
OAnalysis of written artifacts proresaonat standarda CiReview of student research 
LComprehensive, certification, or IRE HIEW GF SESS ORSEFECE DN, CREE OOther (please specify): 


component 


prettasstorehengints) Click here to specify. 


(Capstone project 
OOral presentation P ii: 


Ointernshi 
OCourse project p 


Olnterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability to analyze complex situations accurately (Excel Column D) 
e if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


2. External reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
e link to an online survey. 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes XINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 6.2 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3.8 out of 5 Goal achieved 
Internal Portfolio Reviews: 4 out of 5 No goal set during first year 
Internship Evaluations: 6.2 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Results indicate that there was a lack of hard journalism or in-depth reporting in the portfolios. Additional hard-hitting/in-depth 
stories are required in the capstone class. Suggestions include a non-sport news story and perhaps one story that includes an FOIA 
filing. 


Timeline for the Assessment 
XlEach Semester Yearly Clevery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected, Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome, 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey CBenchmarking []Performance or jury 
DRating of skills (e.g., rubrics) O Measuring effectiveness relative to visual collection (photos, videos, etc.) 
rofessional standards 
(Analysis of written artifacts p OReview of student research 
C Review of thesis/dissertation/ creative 


&lComprehensive, certification, or OOther (please specify): 


à component 
professional exam(s) 


; Click here to specify. 
CCapstone project 
ClOral presentation R Bm 


C)Internshi 
OCourse project P 


Interviews 
USatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KlYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.5 out of 5, 





What do the results suggest about student achievement of this learning outcome? 
Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 


theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 


Timeline for the Assessment 
Xl Each Semester Yearly ClEvery other year 


1 





D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques oj 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods. All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total; 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XxlSurvey Benchmarking ClPerformance or jury 
Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p COReview of student research 
C Review of thesis/dissertation/ creative 


Licomprehensive, certification, or (Other (please specify): 


: component 
professional exam(s) 


Click here to specify, 
Capstone project 
OoOral presentation P proj 


Internshi 
COCourse project 3 


. i OlInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
° ifthe student’s work reflected the ability gather information (Excel Column H) 

» ifthe student used creativity to gather information (Excel Column |) 

e if the student’s work used multiple methods & sources to research (Excel Column J) 

» ifthe student had the ability communicate how information was gathered (Excel Column K) 


, Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
e linkto an online survey. 


N 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
External portfolio reviews: Score better than 2017 (2017 average was 3.9 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.2) 





Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.93 out of 5 — Goal achieved 
Internal portfolio reviews: 4 out of 5 - No goal set 
Internship Evaluations: 6.2 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


XlEach Semester Yearly [JEvery other year 
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D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties, 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2, Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey OBenchmarking Performance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to Xl Visual collection (photos, videos, etc.) 
A : rofessional standards : 
Analysis of written artifacts p CReview of student research 
O Review of thesis/dissertation/ creative 


OComprehensive, certification, or ClOther (please specify): 


3 component 
professional exam(s) 


Da Capstone project Click here to specify. 
(Oral presentation 


Internshi 
(Course project 5 


CInterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? xlYes ONo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.8 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.6) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 3,4 out of 5 — goal not achieved 
Internal Portfolio Reviews: 4 out of 5 — no goal set 
Internship Supervisor Reviews: 6.2 out of 7 — goal not achieved 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


XlEach Semester Yearly LlEvery other year 
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D8) Student Learning Outcome #8: students will demonstrate an understanding of relevant planning Gnd management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation, The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey CiBenchmarking (Performance or jury 
ORating of skills (e.g., rubrics) Cl Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
(Analysis of written artifacts P CReview of student research 
OReview of thesis/dissertation/ creative 


[1Comprehensive, certification, or COther (please specify): 


f component 
professional exam(s) 


z Click here to specify. 
L1Capstone project 
(Oral presentation R prel 


OInternshi 
OCourse project 4 


Interviews 
Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KYes LINo 
Score 4+ or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8, 
Score was 3.75 out of 5 — goal not achieved 


What do the results suggest about student achievement of this learning outcome? 
MMI] faculty need to address this Learning Outcome in appropriate classes. Seniors scored this as the lowest Learning Outcome 


Timeline for the Assessment 
XlYearly ClEvery other year 





E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 
p 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 


and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 
Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs, 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 


assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations, 





G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 


No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 








Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 


The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 





Senior Exit Survey 


1, Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3, Learning Outcome #3; Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5. Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 
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Internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


he 


2. An understanding of the relevance of human diversity in 
mass communications. 


Rie =e fal 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 





5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in mass 
communications. 





8. An understanding of relevant planning and management 
methods in mass communications. 


pet ht e 218 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Learning Outconied: | 


Learning Outcome 4; Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 


nk wn Re 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


The ability to craft innovative solutions to difficult problems. 


1 
2 
3 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to look beyond what is obvious and understand what lies beneath the surface. 


1 
2 
a 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome, 


The ability to effectively communicate complex ideas and make them understandable. 


ob WN 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 
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Learning Outcomes 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


ne wn 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome, 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome, 


nae U Ne 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Uu oe U Ne 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome, 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Teaming Outcome 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


mf WN 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


mf WN RP 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


oP wn 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


mW bw Ne 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Conclusion 


The portfolio is professional and will help the student find employment after graduation 


nk U Ne 


5 Strongly Agree. 

4 Agree, 

3 Neither agree nor disagree, 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


U ser Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 





Average Grade 


Class Average: et re ry 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


U ser Sta tisti cs Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 


grs 23% UA 75% 1005% 


Average Grade 


Class Average: Pt en a ey 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 











2017 - 2018 
Annual Assessment Report 


Bachelor of Arts 
Strategic Communication 





OKLAHOMA School of Media & Strategic Communication 
Strategic Communications — Bachelor of Arts 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY. 





Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2017-2018: 82 
Number of students graduated in 2017-2018: 32 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Critical thinking 

e Creativity 

* Global awareness 

¢ Appreciation for the liberal arts 

e Adaptability 

*  Problem-solving skills 

* Diversity 

e Leadership 

e Community involvement 








C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES [JNo 
if university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 





D. Student Learning Outcomes 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 





Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2,3,5&8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 
Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 


briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 24 


Spring 2018 Post Test: 18 
Senior Exits: 5 
Total: 47 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey Benchmarking OPerformance or jury 
CRating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p C Review of student research 
O Review of thesis/dissertation/ creative 


XIComprehensive, certification, or OOther (please specify): 


. component 
professional exam(s) 


P Click here to specify. 
CCapstone project 
OoOral presentation p PE 


OiInternshi 
OCourse project j 


> Interviews 
OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test; All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21-30 pertain to Mass Communication Law 
* Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? KlYes XI No 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SC — BA students who took the pretest 20 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law); 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SC-BA students who took the posttest: 31 percent 
Questions measuring Learning Outcome #1: 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.7 out of 5 


What do the results suggest about student achievement of this learning outcome? 

Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. The post scores were lower than expected. However, this is the first year for the exam. Scores can 
be improved by replacing some questions to better reflect the learning outcome. Things to consider this year and as we move 


forward: 
e Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
° Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 


full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester XlYearly ClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the 
relevance of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia 
journalism curricula, including but not limited to data journalism, reporting and media management. 

How many students were included in the assessment of this outcome? 

5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed all graduating seniors asking for participation, The first five students (from 
each program) to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to 
rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking Performance or jury 
CRating of skills (e.g., rubrics) C Measuring effectiveness relative to Ovisual collection (photos, videos, etc.) 


’ rofessional standards 3 
OAnalysis of written artifacts P CReview of student research 
COReview of thesis/dissertation/ creative 


component COther (please specify): 


LlComprehensive, certification, or 
professional exarti(s) Click here to specify 
, CCapstone project ; 
OOral presentation 


OInternshi 
CiCourse project p 


Interviews 
C)Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes, After the interview, students 
completed a Learning Outcome survey that included the following ratings scale: 


Did your department/program faculty have a goal set for this learning outcome? XlYes CINo 
Goal: receive a rating of 4.2+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 

Senior Exits: Learning Outcome #2 received a rating of 4.6 out of 5, which achieves the faculty goal. 

Senior students “strongly agree” they understand and have learned a lot about the relevance and need for diversity in mass media 
and communications. No weaknesses discovered. 


What do the results suggest about student achievement of this learning outcome? 


Goal Achieved. 4.6 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
XK Each Semester OYearly ClEvery other year 








D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 
communications. 
Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 24 


Spring 2018 Post Test: 18 
Senior Exits: 5 
Total: 47 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey C1Benchmarking C)Performance or jury 
(Rating of skills (e.g., rubrics) O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
rofessional standards 
DAnalysis of written artifacts P OReview of student research 
C Review of thesis/dissertation/ creative 


ClComprehėnsive, certification, or ClOther (please specify): 


é component 
professional exam(s) 


y cli ify. 
] Fltapstone project ick here to specify. \ 
OOral presentation 


OInternshi 
OCourse project 


OiInterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? klYes xINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 





Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits 

Seniors rated this outcome: 4.2/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press in a 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

* Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history, social roles and diversity. 


Timeline for the Assessment 
Each Semester Kl Yearly CEvery other year 





D4) Student Learning Outcome #4: Students will demonstrate critical, creative and Independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 - Electronic Reporting 

e $C 3353 - Persuasive Writing 

e SC 3363 — Graphic Design 

e §C 3463 — Event Planning 

* §C 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 





1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Èd Survey 
Rating of skills (e.g., rubrics) 
Analysis of written artifacts 


[1Comprehensive, certification, or 
professional exam(s) 


OoOral presentation 
COCourse project 


(Satisfaction Survey 


CBenchmarking 


& Measuring effectiveness relative to 
professional standards 


CO Review of thesis/dissertation/ creative 
component 


OCapstone project 
Olnternship 


OInterviews 


C)Performance or jury 

Visual collection (photos, videos, etc.) 
Review of student research 

OOther (please specify): 

Click here to specify. 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 

e ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 
e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


N 


link to a student portfolio 
link to an online survey. 


. External reviewers each reviewed five portfolios. Reviewers received two links: 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 


scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes KXINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internship Evaluations: Score better than 2017 (2017 average was 6.7 out of 7) 

Internal Portfolio Review: First year — no goal 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 4 out of 5 Goal achieved 
Internal Portfolio Reviews: 4,1 out of 5 No goal set during first year 
Internship Evaluations: 6.8 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Portfolios: Students are better than average at problem solving and critical thinking. Scores increased from 2017. 

The major needs to do a better job helping students analyze complex situations. Although their ability to communicate complex 
situations is better, more rigor in complex problem-solving throughout the entire curriculum should be introduced. Perhaps it’s a 
generational thing as the rise of social media has made it convenient to glide across information without proper in-depth analysis. 
However, it is important for SMSC students to understand the ramifications of complex problems and the art of finding purposeful 


solutions. 


Timeline for the Assessment 
Each Semester XlYearly LlEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 
concepts of mass communication. 
Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 


Fall 2017 & Spring 2018 Pre Test; 24 


Spring 2018 Post Test: 18 
Senior Exits: 5 
Total: 47 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey 


CRating of skills (e.g., rubrics) 


OBenchmarking 


C Measuring effectiveness relative to 
professional standards 


C Performance or jury 
OVisual collection (photos, videos, etc.) 


CO Review of student research 


DiAnalysis of written artifacts 
C Review of thesis/dissertation/ creative 


corhponient COther (please specify): 


&lComprehensive, certification, or 

rofessi i ; 
poa Ficanstone niotect Click here to specify. 
COral presentation p i: 


OlInternshi 
(Course project g 


Xlinterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? XlYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 

Posttest — 42 percent answered correctly 

Seniors ranked this learning outcome as 4.6 out of 5. Goal achieved. 
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What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled from the pre to post test, which indicates a positive learning curve. However, scores are still low. 
Recommendations: SMSC should add two more questions to better assess mass communication history, diversity in mass 
communication and the importance of a free press in a democratic society. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 
Senior students “strongly agree” they understand and have learned a lot about the relevant theories and concepts of mass 


communications. 


Timeline for the Assessment 
kxlEach Semester Yearly LlEvery other year 
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D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques of 


research und information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students in Strategic Communication are required to take a course in Research Methods. All students are required to use 
research and data in their capstone project. Students must also demonstrate research skills when collecting data for writing 
courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X)Survey (Benchmarking (Performance or jury 
Xl Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
XlAnalysis of written artifacts C)Review of student research 
C Review of thesis/dissertation/ creative 


[JComprehensive, certification, or ClOther (please specify): 


A component 
professional exam(s) 


Cicanstone project Click here to specify. 
OoOral presentation 


KJinternshi 
OCourse project P 


a Olnterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 


1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
* ifthe student’s work reflected the ability gather information (Excel Column H) 

e ifthe student used creativity to gather information (Excel Column 1) 

» ifthe student’s work used multiple methods & sources to research (Excel Column J) 

° if the student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
External portfolio reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 
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Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.91 out of 5 — Goal achieved 
Internal portfolio reviews: 3.91 out of 5 - No goal set 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done, Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


Each Semester Yearly CEvery other year 
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D7) Student Learning Outcome #7: Students wil! demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey COBenchmarking Cl Performance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to )Visual collection (photos, videos, etc.) 
p , p rofessional standards n 
XAnalysis of written artifacts P OReview of student research 
O Review of thesis/dissertation/ creative 


CComprehensive, certification, or OOther (please specify): 


š component 
professional exam(s) 


f XCapstone project Click here to specify. 
OoOral presentation 


Xl Internshi 
(Course project i 


OlInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 4.3 outof 5 
Internal Portfolio Reviews: 3.8 out of 5 
Internship Supervisor Reviews: 6.8 out of 7 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


XEach Semester klYearly LlEvery other year 
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D8) Student Learning Outcome #8: Students will demonstrate an understonding of relevant planning and management 
methods in mass communication 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns, 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey OBenchmarking (Performance or jury 
Rating of skills (e.g., rubrics) C Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
OMAnalysis of written artifacts P OReview of student research 
O Review of thesis/dissertation/ creative 
Ocomprehensive, certification, or component / / OOther (please specify): 
professional exam(s) ‘ } 
‘ Click here to specify. 
P []Capstone project 
Oral presentation 
OInternship 


ClCourse project 


Interviews 
Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted, 
Senior Exit Interview & Survey; Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? XYes ONo 
Score 4.4 out of 5 (2017 score) 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 4.8 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 
concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
KlYearly DEvery other year 





E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 
assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 





interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 


Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 
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Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 





The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 





H. Assessment Tools 





Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree -5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3; Students will demonstrate respect for the history and social role of mass communications 
Strongly agree-5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5, Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 
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Internship Supervisor Learning Outcome Evaluation 


To what extent does the intern demonstrate the following 
characteristics? 


Not demonstrated 
Demonstrated 
only slightly 
Demonstrated 
occasionally 
Demonstrated but 
needs work 
demonstrated 


Expertly 


+ 
> 





1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 





7. Appropriate writing, editing and production techniques in mass 
communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 





3 
g 
$ 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Yearning Outcomes , 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 


ua fw DM Be 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to craft innovative solutions to difficult problems. 


wb WN Be 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to look beyond what is obvious and understand what lies beneath the surface. 


1 
2 
3 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to effectively communicate complex ideas and make them understandable. 


ot wWN 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome, 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


21 











Teaming Outconie G 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nA UNBe 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Uv oe U Ne 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


v oA NUNE 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Learning Outcome 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


nb won 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nb wn Pe 
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Evidence of the ability to craft language for interesting and effective commuication, 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nF WN 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


oa Oe W Ne 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Gonclusión 


The portfolio is professional and will help the student find employment after graduation 


on A WW Ne 


5 Strongly Agree. 

4 Agree. 

3 Neither agree nor disagree. 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users ssu 





Average Grade 


Class Average: poeeme eee ey 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts Nagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 





Average Grade 


Class Average: | ee ny 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempls flagged as graded. 


24 








2017 - 2018 
Annual Assessment Report 


Bachelor of Science 
Strategic Communication 





TUTIL School of Media & Strategic Communication 
Strategic Communications — Bachelor of Science 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 





Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 196 
Number of students graduated in 2017-2018: 63 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Criticalthinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

* Problem-solving skills 

e Diversity 

e Leadership 

* Community involvement 





C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field, Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
ə Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 








D. Student Learning Outcomes 
Learning outcome 1. 





Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 


Learning outcome 2. 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 


Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 


communication. 


Learning outcome 5. 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 


Students will demonstrate an understanding of the writing, editing and production techniques of mass 


communication specialties. 


Learning outcome 8. 


Students will demonstrate an understanding of relevant planning and management methods in mass 


communication. 


Method 

Senior exits 

Portfolio Assessment 
Pre-Post Test 


Internship Assessment 


Measured 

Learning Outcomes 1, 2,3,5&8 
Learning Outcomes 4, 6 and 7 
Learning Outcomes 1, 3, 5, 7 


Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 
briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 55 


Spring 2018 Post Test: 46 
Senior Exits: 5 
Total: 106 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey OBenchmarking Performance or jury 
ORating of skills (e.g., rubrics) Ll Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
à , rofessional standards , 
ClAnalysis of written artifacts & (Review of student research 
O Review of thesis/dissertation/ creative 


Comprehensive, certification, or OOther (please specify): 


i component 
professional exam(s) 


- Ceanstonaprojert Click here to specify. 
OOral presentation 


OiInternshi 
Course project P 


Interviews 
Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MM) 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 
e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes XI No 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SC — BS students who took the pretest 21 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SC — BS students who took the pretest 32 percent 
Questions measuring Learning Outcome #1: 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.7 out of 5 


What do the results suggest about student achievement of this learning outcome? 

Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. The post scores were lower than expected, However, this is the first year for the exam. Scores can 
be improved by replacing some questions to better reflect the learning outcome. Things to consider this year and as we move 


forward: 
e Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


XlEach Semester XYearly OlEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications, 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to 
respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Xl Survey Benchmarking O Performance or jury 
CO Rating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 


professional standards 


L1Analysis of written artifacts (Review of student research 


OReview of thesis/dissertation/ creative 


[lComprehensive, certification, or (Other (please specify): 


: component 
professional exam(s) : F 
Ticapsranapedject Click here to specify. 
OoOral presentation 
CInternship 


(Course project 


Interviews 
(Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey that included the following ratings scale: 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
Goal: receive a rating of 4.2+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 

Report student’s scores for this assessment, as well as students’ strengths and weaknesses relative to this learning outcome. 
Senior Exits: Learning Outcome #2 received a rating of 4.6 out of 5, which achieves the faculty goal. 

Senior students “strongly agree” they understand and have learned a lot about the relevance and need for diversity in mass media 
and communications. No weaknesses discovered. 


What do the results suggest about student achievement of this learning outcome? 
Goal Achieved. 4.6 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
XlEach Semester OYearly LlEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. 


How many students were included in the assessment of this outcome? 


Fall 2017 & Spring 2018 Pre Test: 55 


Spring 2018 Post Test: 46 
Senior Exits: 5 
Total: 106 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of 


the learning outcome. 


Assessment Methods 


Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey 
(Rating of skills (e.g., rubrics) 
CAnalysis of written artifacts 


[]Comprehensive, certification, or 
professional exam(s) 


OOral presentation 
[Course project 


DSatisfaction Survey 


CBenchmarking 


O Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


OCapstone project 
CInternship 


Uinterviews 


O Performance or jury 

OVisual collection (photos, videos, etc.) 
C]Review of student research 

ClOther (please specify): 

Click here to specify. \ 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace, 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 


KINo 








Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits 

Seniors rated this outcome: 4.2/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free pressina 

democratic society, Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

> Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Goal achieved. Seniors are comfortable with their knowledge of mass communication history and social role of mass 


communication. 


Timeline for the Assessment 
XEach Semester XYearly ClEvery other year 








D4) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 — Electronic Reporting 

* $C 3353 - Persuasive Writing 

* SC 3363 — Graphic Design 

e SC 3463 — Event Planning 

* SC 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

* SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey Benchmarking OPerformance or jury 
lRating of skills (e.g., rubrics) XI Measuring effectiveness relative to KlVisual collection (photos, videos, etc.) 


rofessional standards 3 
DAnalysis of written artifacts P C Review of student research 
C Review of thesis/dissertation/ creative 


component OOther (please specify): 


Comprehensive, certification, or 
professional exam(s) Click here to specify 

: C1 Capstone project i 
OOral presentation 


C1 Internshi 
C1Course project p 


> ‘ OiInterviews 
CO Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
e ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

* ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


2. External reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
e linkto an online survey. 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student's work and rate the work on a seven-point- 


scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes KINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internship Evaluations: Score better than 2017 (2017 average was 6.7 out of 7) 

Internal Portfolio Review: First year — no goal 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 4 out of 5 Goal achieved 
Internal Portfolio Reviews: 4.1 out of 5 No goal set during first year 
Internship Evaluations: 6.8 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Portfolios: Students are better than average at problem solving and critical thinking. Scores increased from 2017. 

The major needs to do a better job helping students analyze complex situations. Although their ability to communicate complex 
situations is better, more rigor in complex problem-solving should be introduced. Perhaps it’s a generational thing as the rise of 


social media has made it convenient to glide across information without proper in-depth analysis. However, it is important for SMSC 


students to understand the ramifications of complex problems and the art of finding purposeful solutions. 


Timeline for the Assessment 
XlEach Semester Yearly LlEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 55 


Spring 2018 Post Test: 46 
Senior Exits: 5 
Total: 106 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey [1Benchmarking C)Performance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
rofessional standards 
DAnalysis of written artifacts p C Review of student research 
Review of thesis/dissertation/ creative 
XiComprehensive, certification, or component / / Oother (please specify): 
professional exam(s) : , 
s Click here to specify. 
, OCapstone project 
OOral presentation 
Olnternship 


ClCourse project 


’ Interviews 
D Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? lYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 

Posttest — 42 percent answered correctly 

Seniors ranked this learning outcome as 4.6 out of 5. 
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What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled from the pre to post test, which indicates a positive learning curve. However, scores are still low. 
Recommendations: SMSC should add two more questions to better assess mass communication history, diversity in mass 
communication and the importance of a free press in a democratic society. 


Senior Exits: 

Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the faculty goal. 

Senior students “strongly agree” they understand and have learned a lot about the relevant theories and concepts in mass 
communications. 


Timeline for the Assessment 
Each Semester KlYearly O Every other year 





D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methacs and techniques of 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students in Strategic Communication are required to take a course in Research Methods. All students are required to use 
research and data in their capstone project. Students must also demonstrate research skills when collecting data for writing 
courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey C1Benchmarking (]Performance or jury 

XRating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
XlAnalysis of written artifacts professional standards ClReview of student research 
(1Comprehensive, certification, or Lil fevieima? theals/esseriaten/ nreatve OOther (please specify): 


component 


professional exam(s) Click here to specify. 


O Capstone project 
OOral presentation P pisi 


Xinternshi 
Course project p 


OInterviews 
QSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
* ifthe student’s work reflected the ability gather information (Excel Column H) 

e ifthe student used creativity to gather information (Excel Column |) 

¢ ifthe student’s work used multiple methods & sources to research (Excel Column J) 

» ifthe student had the ability communicate how information was gathered (Excel Column K) 


. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
* link to an online survey. 


N 


2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
External portfolio reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 





Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.91 out of 5 — Goal achieved 
Internal portfolio reviews: 3.91 out of 5- No goal set 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


KlEach Semester xl Yearly ClEvery other year 
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D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1, Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey C Benchmarking C1Performance or jury 

Rating of skills (e.g., rubrics) O Measuring effectiveness relative to XI Visual collection (photos, videos, etc.) 
Analysis of written artifacts professional snes OReview of student research 
CLicomprehensive, certification, or Einiwlew of tresis/dlsseetet ery ateoitur LlOther (please specify): 


component 


professional exam(s} Click here to specify. 


X Capstone project 
OoOral presentation 5 prol 


Xinternshi 
OCourse project P 


eo UiInterviews 
DSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? lYes LINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 4.3 out of 5 
Internal Portfolio Reviews: 3.8 out of 5 
Internship Supervisor Reviews: 6.8 out of 7 
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What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester XlYearly ClEvery other year 
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D8) Student Learning Outcome #8: Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 
How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were selected. Students 
were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of the learning 


outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey Benchmarking OPerformance or jury 
ORating of skills (e.g., rubrics) C Measuring effectiveness relative to Ovisual collection (photos, videos, etc.) 
rofessional standards 
C Analysis of written artifacts j OReview of student research 
OReview of thesis/dissertation/ creative 


CiComprehensive, certification, or Other (please specify): 


A component 
professional exam(s) 3 k 
Pitapstone project Click here to specify. 
OoOral presentation 
Onternshi 
[Course project 4 
interviews 


OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 
Score same or better than 2017. 2017 score was 4.4 out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 4.8 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 


concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
KlYearly ClEvery other year 





E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role, New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 


assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 





Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 





The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content, 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey, 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 





H. Assessment Tools 


Senior Exit Survey 


1, Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4, Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5. Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 





Internship Supervisor Learning Outcome Evaluation 


To what extent does the intern demonstrate the following 
characteristics? 


Not applicable 
Not demonstrated 
Demonstrated 
only slightly 
Demonstrated 
Demonstrated but 
needs work 


occasionally 
demonstrated 


N| Expertly 














1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in mass 
communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Learning Outcone4: 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 
No or poor representation of learning outcome. 


Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


nt WN 


The ability to craft innovative solutions to difficult problems, 
No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nos WN PR 


The ability to look beyond what is obvious and understand what lies beneath the surface. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nt WN PR 


The ability to effectively communicate complex ideas and make them understandable. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


af WN PR 
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Tearing Outconie g 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome., 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


n A UNG 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


aot wn re 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nn fF wWN 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Ueamning Outcome: / 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


nF wn eB 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


of WN PR 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


np wn 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


mt wn Pe 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The portfolio is professional and will help the student find employment after graduation 


op WN RP 


Strongly Agree. 

Agree. 

Neither agree nor disagree. 
Disagree. 

Strongly Disagree. 


PNW AM 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


U ser Sta tistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 





Average Grade 


Class Average: y amema a emea a- 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 








Percentage of Users 





Average Grade 


Class Average: r ae re ae 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Arts 
Sports Media 





TETIT School of Media & Strategic Communication 
Sport Media — Bachelor of Arts 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 





Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 54 
Number of students graduated in 2017-2018: 13 





B. Program Mission Statement 


In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

* = Critical thinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

e Problem-solving skills 

* Diversity 

e Leadership 

* Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 











D. Student Learning Outcomes 





Learning outcome 1. 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 


Learning outcome 2. 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 


Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 


communication. 


Learning outcome 5. 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 


Students will demonstrate an understanding of the writing, editing and production techniques of mass 


communication specialties. 


Learning outcome 8. 


Students will demonstrate an understanding of relevant planning and management methods in mass 


communication. 


Method 

Senior exits 

Portfolio Assessment 
Pre-Post Test 


Internship Assessment 


Measured 

Learning Outcomes 1, 2, 3, 5 & 8 
Learning Outcomes 4, 6 and 7 
Learning Outcomes 1, 3, 5, 7 


Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 


briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey C)Benchmarking C]Performance or jury 
ORating of skills (e.g., rubrics) OMeasuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
OAnalysis of written artifacts p OReview of student research 
OReview of thesis/dissertation/ creative 


IComprehensive, certification, or COther (please specify): 


> component 
professional exam(s) 


[ Click her t i F 
Ora r i LCapstone project ! eto specify 


CInternshi 
CCourse project j 


: > Interviews 
OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 
e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? X Yes XI No 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SPM — BA students who took the pretest 21 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SPM-BA students who took the posttest: 36 percent 
Questions measuring Learning Outcome #1; 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.4 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
*  Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication, 


Timeline for the Assessment 


Xl Each Semester klYearly OClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of humar 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey 
ORating of skills (e.g., rubrics) 
OAnalysis of written artifacts 


Cicomprehensive, certification, or 


CBenchmarking 


C Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


CPerformance or jury 
OVisual collection (photos, videos, etc.) 
OReview of student research 


OOther (please specify): 


piotendonal enone) F Click here to specify. 
: CCapstone project 
LOral presentation 


OInternshi 
OCourse project p 


Xinterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? KlYes CINo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.4 out of 5, which achieves the goal. 
Senior students “agree” they have an understanding of the history and social roles in mass communications. 


What do the results suggest about student achievement of this learning outcome? 
Goal Achieved. 4.4 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 


Each Semester OYearly LlEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for Lhe history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: p 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester, All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 


Brightspace during the final few weeks of the semester. 


Senior Exit Survey; Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected, Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 


understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey CBenchmarking 


ORating of skills (e.g., rubrics) O Measuring effectiveness relative to 


rofessional standards 
C Analysis of written artifacts p 


OReview of thesis/dissertation/ creative 


Comprehensive, certification, or 
component 


professional exam(s) 
OCapstone project 
OoOral presentation ili 


Ointernshi 
Course project 3 H 


OIntervi 
OSatisfaction Survey nterviews 


(Performance or jury 

Ovisual collection (photos, videos, etc.) 
CiReview of student research 

COther (please specify): 

Click here to specify. \ 


Describe the how the assessment method was implemented, administered, and/or conducted, 


Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 


interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 


XI No 








Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits 

Seniors rated Learning Outcome #3: 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press ina 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

e Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
Each Semester KlYearly CEvery other year 








D4) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 — Electronic Reporting 

e SC 3353 - Persuasive Writing 

e §C 3363 — Graphic Design 

e SC 3463 — Event Planning 

e SC 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


lSurvey Cl Benchmarking OPerformance or jury 
X Rating of skills (e.g., rubrics) X Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
ClAnalysis of written artifacts p OReview of student research 
C Review of thesis/dissertation/ creative 


Ccomprehensive, certification, or (Other (please specify): 


i component 
professional exam(s) 


l Ciĉapstoie project Click here to specify. 
LOral presentation 


OiInternshi 
Course project k 


Olnterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1, Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability to analyze complex situations accurately (Excel Column D) 
e if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

ə ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


. External reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
link to an online survey. 


N 








2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes Xx] No 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.65 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 5.8 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3.3 out of 5 Goal not achieved 
Internal Portfolio Reviews: 3.5 out of 5 No goal set during first year 
Internship Evaluations: 6.6 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Results indicate that there was a lack of hard journalism or in-depth reporting in the portfolios. Additional hard-hitting/in-depth 
stories are required in the capstone class. Suggestions include a non-sport news story and perhaps one story that includes an FOIA 
filing. 


Timeline for the Assessment 
Each Semester XlYearly DEvery other year 





D5) Student Learning Outcome #5: Students wil! demonstrate an understanding of the relevant theories ond 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester, 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking CPerformance or jury 
ORating of skills (e.g., rubrics) CO Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p C Review of student research 
O Review of thesis/dissertation/ creative 


Xl Comprehensive, certification, or COther (please specify): 


i component 
professional exam(s) 


; Click here to specify, 
CCapstone project 
OoOral presentation p pe 


Olnternshi 
OCourse project p 


y ; Interviews 
CSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? lYes CINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.6 out of 5. 








What do the results suggest about student achievement of this learning outcome? 
Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 


theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the faculty goal. 


Timeline for the Assessment 
Each Semester klYearly O Every other year 





D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques of 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods, All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


&lSurvey O Benchmarking OPerformance or jury 

Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
XlAnalysis of written artifacts protistrana OReview of student research 
[1Comprehensive, certification, or neviem afithatls/alssemiations trente COther (please specify): 


component 


professional exam(s) Click here to specify. 


C Capstone project 
CoOral presentation i i 


Internshi 
Course project P 


: CInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability gather information (Excel Column H) 

e if the student used creativity to gather information (Excel Column 1) 

e ifthe student’s work used multiple methods & sources to research (Excel Column J) 

> ifthe student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
e link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
External portfolio reviews: Score better than 2017 (2017 average was 3.77 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 
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Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.91 out of 5 — Goal achieved 
Internal portfolio reviews: 3.15 out of 5 - No goal set 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


Each Semester klYearly ClEvery other year 





D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


ÈI Survey O Benchmarking Performance or jury 

Rating of skills (e.g., rubrics) O Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
Analysis of written artifacts professightl standas OReview of student research 
Licomprehensive, certification, or Higiea arih /Msarhaan mosie COther (please specify): 


component 


hrofessional exams) Click here to specify. 


X Capstone project 
OoOral presentation p proj 


Internshi 
OCourse project p 


UiInterviews 
DSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? klYes CINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 3.4 out of 5 — goal not achieved 
Internal Portfolio Reviews: 3.15 out of 5 
Internship Supervisor Reviews: 6.8 out of 7 — goal achieved 
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What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester XYearly Every other year 





D8) Student Learning Outcome #8: Students will demonstrate on understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected, Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


KSurvey 
O Rating of skills (e.g., rubrics) 
LAnalysis of written artifacts 


Comprehensive, certification, or 
professional exam(s) 


OOral presentation 
O Course project 


O Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 


OBenchmarking 


O Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


CCapstone project 
OInternship 


interviews 


(Performance or jury 

OVisual collection (photos, videos, etc.) 
CReview of student research 

COther (please specify): 

Click here to specify. 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale, 


Did your department/program faculty have a goal set for this learning outcome? 


Score 4.4 or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 


Score was 4.6 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 
concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
Xl Yearly 


ClEvery other year 


ONo 
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E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 
perceived as trivia should be eliminated. 


The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 
assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 
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Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 


The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 





Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5, Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 





internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


E: 





2. An understanding of the relevance of human diversity in 
mass communications. 





3. An understanding of the history and social role of mass 
communications. 








4. Critical, creative and individual thinking. 








5. An understanding of the relevant theories and concepts of 
mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 





7. Appropriate writing, editing and production techniques in mass 
communications. 





8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Leaning Outcome 4 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 


aA UNa 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to craft innovative solutions to difficult problems. 


mewn 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


The ability to look beyond what is obvious and understand what lies beneath the surface. 


1 
2 
3 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to effectively communicate complex ideas and make them understandable. 


mon Pwond Fe 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 
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Learning, Outcome (6) 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


own pe 


Evidence of initiative and creativity in information gathering, 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


op WN 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nt U NHE 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Learning Outconre’7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


noA U Ne 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


U eA U Ne 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


mot wonr 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


u A UNa 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The portfolio is professional and will help the student find employment after graduation 


me WU Ne 


5 Strongly Agree. 

4 Agree. 

3 Neither agree nor disagree. 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


U ser Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 





Average Grade 


Class Average: et 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 





0% 25% ww 75% 


Average Grade 


Class Average: t= ——————— 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Science 
Sports Media 








pam School of Media & Strategic Communication 
Sport Media — Bachelor of Science 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





® 


Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2017-2018: 98 
Number of students graduated in 2017-2018: 28 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 
e = Critical thinking 
Creativity 
Global awareness 
Appreciation for the liberal arts 
Adaptability 
Problem-solving skills 
Diversity 
Leadership 
Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? XYES No 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
ə 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
ə Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 





D. Student Learning Outcomes 
Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2, 3,5 & 8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 
Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 


briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 31 


Spring 2018 Post Test: 16 
Senior Exits: 5 
Total: 52 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XJSurvey ClBenchmarking C)Performance or jury 

ORating of skills (e.g., rubrics) [Measuring effectiveness relative to Clvisual collection (photos, videos, etc.) 
OAnalysis of written artifacts professional standards OReview of student research 
Comprehensive, certification, or OiReview of thesis/dissertation/ creative ClOther (please specify): 


component 


professional exam(s} Click here to specify 


C)Capstone project 
Oral presentation p pec 


Olnternshi 
OCourse project p 


; : KllInterviews 
KSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 
e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KlYes KINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 





Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SPM — BS students who took the pretest 22 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SPM-BS students who took the posttest: 35 percent 
Questions measuring Learning Outcome #1: 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.4 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
ə Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
e Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 


full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester Yearly ClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications: 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


iSurvey 
ORating of skills (e.g., rubrics) 
CAnalysis of written artifacts 


Comprehensive, certification, or 
professional exam(s) 


(JOral presentation 
OCourse project 


LSatisfaction Survey 


C1 Benchmarking 


O Measuring effectiveness relative to 
professional standards 


Review of thesis/dissertation/ creative 
component 


CCapstone project 
CiInternship 


Interviews 


(Performance or jury 
OWVisual collection (photos, videos, etc.) 
Review of student research 
Clother (please specify): 
Click here to specify. 


Describe the how the assessment method was implemented, administered, and/or conducted. 


Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.4 out of 5. 


What do the results suggest about student achievement of this learning outcome? 
Goal Achieved. 4.4 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 


XJEach Semester LlYearly Every other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 
communications. 
Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


CSurvey LiBenchmarking (Performance or jury 
ORating of skills (e.g., rubrics) O Measuring effectiveness relative to Oisual collection (photos, videos, etc.) 
, , ; rofessional standard 3 
OAnalysis of written artifacts ee ia CReview of student research 
OReview of thesis/dissertation/ creative 


CComprehensive, certification, or ponent COther (please specify): 


professional exam(s) : ; 
A Click here to specify. \ 
ClCapstone ect 
OoOral presentation ap Hea 


CInternshi 
ClCourse project P 


OInterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? XYes XINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 





Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions -#41-50 55 percent 
Senior Exits 

Seniors rated Learning Outcome #3: 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press ina 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

e Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

e Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

ə Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 


effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
Each Semester lYearly CEvery other year 





D4) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 
e MC 2003 - Media Style & Structure 
e MC 2023 -Electronic Reporting 
SC 3353 - Persuasive Writing 
SC 3363 — Graphic Design 
SC 3463 — Event Planning 
SC 3953 — Research Methods 
SC 4493 — Advanced PR Writing 
SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1, Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


ilSurvey OBenchmarking Performance or jury 
XRating of skills (e.g., rubrics) Measuring effectiveness relative to &Visual collection (photos, videos, etc.) 


rofessional standards s 
OAnalysis of written artifacts p OReview of student research 
O Review of thesis/dissertation/ creative 


component COther (please specify): 


Comprehensive, certification, or 


professional exam(s) Click here to specify. 


CCapstone project 
OoOral presentation ap projec 


Ointernshi 
Course project nternsnip 


OInterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability to analyze complex situations accurately (Excel Column D) 
ə ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


_ External reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
link to an online survey. 


N 








2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes KINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.65 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 5.8 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3,6 out of 5 Goal achieved 
Internal Portfolio Reviews: 3.5 out of 5 No goal set during first year 
Internship Evaluations: 6.6 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Results indicate there is room for improvement. Perhaps there is a lack of hard journalism stories or in-depth reporting in the 
portfolios, Additional hard-hitting/in-depth stories are required in the capstone class. Suggestions include a non-sport news story 
and perhaps one story that includes an FOIA filing. 


Timeline for the Assessment 
lEach Semester Yearly LlEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts af mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey Benchmarking Performance or jury 
CRating of skills (e.g., rubrics) C Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
fessional standards 
LAnalysis of written artifacts is 5 OReview of student research 
OReview of thesis/dissertation/ creative 


Comprehensive, certification, or Other (please specify): 


i component 
professional exam(s) 


‘ Click here to specify. 
Capstone project 
OOral presentation p pro 


Llinternshi 
(Course project Serre 


; Interviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test; Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? lYes CINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.6 out of 5. 





What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 
theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 


Timeline for the Assessment 
Each Semester Yearly ClEvery other year 


1] 








D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques of 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods. All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey C1Benchmarking (Performance or jury 
XRating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 


‘ . rofessional standards y 
XAnalysis of written artifacts p OReview of student research 
CReview of thesis/dissertation/ creative 


japona COther (please specify): 


Licomprehensive, certification, or 
pRTRSslon glean} Click here to specify 

A OCapstone project : 
CoOral presentation 


Internshi 
Course project P 


r Cinterviews 
USatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
ə ifthe student’s work reflected the ability gather information (Excel Column H) 

e ifthe student used creativity to gather information (Excel Column l) 

ə ifthe student's work used multiple methods & sources to research (Excel Column J) 

e ifthe student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
ə link to a student portfolio 
e link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
External portfolio reviews: Score better than 2017 (2017 average was 3.7 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 6. 
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External portfolio reviews: 3.7 out of 5 — Goal achieved 
Internal portfolio reviews: 3.15 out of 5- No goal 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Faculty should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


Each Semester XlYearly ClEvery other year 
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D7) Student Learning Outcome #7: Students wil) demonstrate un understanding of the writing, editing and production 


techniques of mass communication specialties, 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking OPerformance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to Visual collection (photos, videos, etc.) 


professional standards 


Analysis of written artifacts OReview of student research 


OReview of thesis/dissertation/ creative 


component LOther (please specify): 


C)Comprehensive, certification, or 

professional exam(s) r > 
3 Click here to specify. 

: XICapstone project 

CJOral presentation p PS 


Internshi 
OCourse project p 


Olnterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 3.5 out of 5 — goal not achieved 
Internal Portfolio Reviews: 3 out of 5 
Internship Supervisor Reviews: 6.6 out of 7 — goal not achieved 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester Yearly ClEvery other year 





D8) Student Learning Outcome #8: Students wil/ demonstrate on understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
9 
How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey Benchmarking OPerformance or jury 

ORating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
ClAnalysis of written artifacts professional standarts CReview of student research 
ClComprehensive, certification, or CiReview of thesis/dissertation/ creative COther (please specify): 


component 


professional exam(s) Click here to specify. 


ClCapstone project 
OoOral presentation p Proj 


Ointernshi 
[Course project Srema 


‘ Interviews 
LSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? klYes LINo 
Score 4.4 or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 4,6 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 
concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
lYearly ClEvery other year 
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E. Summary of Assessment Results 


Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 
assessment cycle, 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 


interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 

Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 
interpreting assessment data. 

The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 


Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 


No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 





Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 


The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content, 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 


Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4, Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5. Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 








Internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 





2. An understanding of the relevance of human diversity in 
mass communications. 





3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. E 
5, An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 

















7. Appropriate writing, editing and production techniques in mass 
communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


leaming Outcomes 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 

No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


aee WN Fe 


The ability to craft innovative solutions to difficult problems. 
No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


A kwWNe 


The ability to look beyond what is obvious and understand what lies beneath the surface. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


uP WN RP 


The ability to effectively communicate complex ideas and make them understandable. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nk wWN e 
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Learning Outcomes 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


nt won & 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nb won 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome, 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


mW oe U N RB 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


Leanning Outcome 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


nN FwWN FR 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


of WN 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nbPwWN FR 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nak WNA 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The portfolio is professional and will help the student find employment after graduation 


mb won ke 


Strongly Agree. 

Agree. 

Neither agree nor disagree. 
Disagree. 

Strongly Disagree. 


eNA 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 





Average Grade 


Class Average: ee i et 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded, 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 
User Stats Question Stats Question Details 
User Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 


Ow 25% 50%% 79% 100% 


Average Grade 


Class Average: bi er ej 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 


24 





2018 — 2019 
Annual Assessment Report 


Bachelor of Arts 
Multimedia Journalism 








Program Information Report 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Information 

Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 35 

Total Number of Students Graduated: 6 

Number of Student Graduates from Stillwater Campus: 6 

Were university assessment funds used by the department/program for assessment activities?: Yes 

Number of Student Graduates from Tulsa Campus: 0 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula, One-hundred percent of the selected participants completed the survey. 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/ Benchmark: Goal achieved: 4.3 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning outcome 
Number of Students Assessed: 6 


Number of Successful Students: 6 
How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 



























09/16/2019 


randomizer. com 
What do the findings suggest about student achievement of this learning outcome?: Results indicate a good representation of 


the learning outcome 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning as they progress through the program. 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: graduating seniors required to take the exam in 
capstone class 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program. 



























Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4 /5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they have learned through classes and have an understanding of the relevance of human diversity 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students understand the importance of 
human diversity in mass communications but all faculty should continue to emphasize its importance in each class and each 


sequence 




















Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


09/26/2019 Generated by Nuventive Improve Page 2 of 8 





Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 








Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Seniors agree they have learned about and have a respect for the history and social role of mass communications 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: online survey offered to all graduating seniors 
What do the findings suggest about student achievement of this learning outcome?: students have a good understanding of the 
diversity issues in mass communication 











Comprehensive, Certification, or Professional Exam/(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 





press. 
Timeline for Assessment: annually 
Findings 
Reporting Period: 2018 - 2019 09/16/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning as they progress through the program, and the questions on the test need to better reflect the subject 
matter of core courses. 

Number of Students Assessed: 20 

Number of Successful Students: 16 

How were students selected to participate in the assessment of this outcome?: all students are required to take the post test in 
their capstone class 

What do the findings suggest about student achievement of this learning outcome?: Students are learning...but better testing / 
test questions are needed 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 

1) if the student's work reflected the ability to analyze complex situations accurately (Excel Column D) 

2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 
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4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.85 125 


Timeline for Assessment: Yearly 





Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated proficiency in critical, creative and independent thinking 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are adequately prepared in 
critical, creative and independent thinking, and there's always room for improvement. Improvement stems from upper-division 
courses requiring assignments that emphasize the importance of critical, creative and independent thinking. 








Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: XX 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Supervisors rated students as proficient to advanced in critical, creative and independent thinking in mass communications 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all credit internships require supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: students are proficiently skilled in critical, 
creative and independent thinking in mass communications 





















Outcome: #5 - Relevant theories and concepts of mass 
communication 
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Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Senior Exit Survey (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 /5 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student results demonstrate a good representation of the understanding of relevant theories and concepts in mass 
communications 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students have a relevant understanding of 
theories and concepts in mass communications, but more theories should be added to the curriculum 





















Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students! scores on the theory question determined students understood the 





theory 

Timeline for Assessment: annually 
Findings 

Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 


the theories 
Number of Students Assessed: 140 


Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should discuss theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 








Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: xx 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 2 - Meets Minimum Program Expectations (Developing) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure...many mark it as NA instead of giving a rating. This question & measurement need to be reassessed. 
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L 
Outcome: #6 - Methods and techniques of research and information 


gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 




































External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.75 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an understanding of the methods and techniques or research and information gathering 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: Randomly selected from a senior list using 





09/20/2019 


randomizer.com 
What do the findings suggest about student achievement of this learning outcome?: Students demonstrated an understanding 


of the methods and techniques or research and information gathering 








Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: XX 
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Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an adequate understanding of the methods and techniques of research and information gathering. 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all students who earn internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are adequately prepared in the 
areas of research and information gathering 











Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 














Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students adequately demonstrated an understanding of writing, editing and production techniques 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
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courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 
* Learning Outcome Goal/Benchmark: 

Pre assessment score were 76/100. 

Post assessment scores were 83 / 100. 





Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: students are learning, but some 
information seems to be forgotten between sophomore and senior year 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication, 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.7 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: students agree they understand the 
relevant planning and management methods 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, 
effective communicators who facilitate and promote participat 
change through lifelong learning. Oklahoma State University Sc 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


ion in a democratic society through excellence in practice, 
hool of Media & Strategic Communications will do this by promoting: 


its neighboring states, the nation and the world to be responsible and 
ethical behavior, a critical stance, and embracing 








Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment; annually 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning 
outcome (09/16/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer. com 

What do the findings suggest about student achievement 
of this learning outcome?: Results indicate a good 
representation of the learning outcome 





Comprehensive, Certification, or 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications, 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications, 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program, (09/16/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: graduating seniors required 
to take the exam in capstone class 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they have learned through classes and have 
an understanding of the relevance of human diversity 
(09/16/2019) 

Number of Students Assessed: 5 

Number of Successful Students; 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students understand the 
importance of human diversity in mass communications but 
all faculty should continue to emphasize its importance in 
each class and each sequence 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Seniors agree they have learned about and have a respect 
for the history and social role of mass communications 
(09/16/2019) 
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Findings 


Use of Findings (Actions)| 





Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 


09/26/2019 


Goal/Benchmark: Goal achieved: 
4/5 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press, 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 


Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: online survey offered to all 
graduating seniors 

What do the findings suggest about student achievement 
of this learning outcome?: students have a good 
understanding of the diversity issues in mass 
communication 

Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program, and the questions on the test need to better 
reflect the subject matter of core courses. (09/16/2019) 
Number of Students Assessed: 20 

Number of Successful Students: 16 

How were students selected to participate in the 
assessment of this outcome?: all students are required to 
take the post test in their capstone class 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning...but 
better testing / test questions are needed 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated proficiency in critical, creative and 
independent thinking (09/16/2019) 
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Outcomes 


~ Assessment Methods 


Findings Use of Findings (Actions) 





independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 
accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student’s work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 


‘Goal/Benchmark: 3.85 / 5 


Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 
survey (see Appendix) - Internship 
Supervisors were asked to assess the 
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Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately 
prepared in critical, creative and independent thinking, and 
there's always room for improvement. Improvement stems 
from upper-division courses requiring assignments that 
emphasize the importance of critical, creative and 
independent thinking. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Supervisors rated students as proficient to advanced in 
critical, creative and independent thinking in mass 
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student's critical, creative and communications (09/20/2019) 

independent thinking / work and Number of Students Assessed: 13 

rate the work on a 7-point-scale. Number of Successful Students: 13 

1 = Not Applicable How were students selected to participate in the 

2 = Understanding Not assessment of this outcome?; all credit internships require 
Demonstrated supervisor evaluations 

3 = Demonstrated Only Slightly What do the findings suggest about student achievement 
4 = Demonstrated Occasionally of this learning outcome?: students are proficiently skilled 
5 = Demonstrated But Needs Work in critical, creative and independent thinking in mass 

6 = Demonstrated Well communications 


7 = Expertly Demonstrated 
* Learning Outcome 
Goal/Benchmark: XX 


#5 - Relevant theories and concepts Survey - Graduating Senior Exit Reporting Period: 2018 - 2019 

of mass communication-Students Survey Conclusion: 3 - Meets Program Expectations (Proficient) 
will demonstrate an understanding of * Learning Outcome Student results demonstrate a good representation of the 
the relevant theories and concepts of Goal/Benchmark: Goal achieved: 4.1 understanding of relevant theories and concepts in mass 
mass communication. 1/5 communications (09/20/2019) 

Outcome Status: Active Number of Students Assessed: 6 

Planned Assessment Year: 2018 - Number of Successful Students: 6 

2019 How were students selected to participate in the 


assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a relevant 
understanding of theories and concepts in mass 
communications, but more theories should be added to the 
curriculum 


Comprehensive, Certification, or Reporting Period: 2018 - 2019 

Professional Exam(s) - Pre-post core Conclusion: 3 - Meets Program Expectations (Proficient) 

curriculum exam One question in the pre-post exam deals with theory - more 

* Learning Outcome questions should be added - faculty should focus on classes 

Goal/Benchmark: Students' scores covering the theories (09/20/2019) 

on the theory question determined Number of Students Assessed: 140 

students understood the theory Number of Successful Students: 140 

Timeline for Assessment: annually How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 
What do the findings suggest about student achievement 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: xx 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 


of this learning outcome?: faculty should discuss theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...many mark it as NA 
instead of giving a rating. This question & measurement 
need to be reassessed. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an understanding of the methods 
and techniques or research and information gathering 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: Randomly selected froma 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrated an 
understanding of the methods and techniques or research 
and information gathering 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#7 - Writing, editing and production 


09/26/2019 


portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale. 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.75 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
- a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


Portfolio Review - In the External 


Generated by Nuventive Improve 


Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students demonstrated an adequate understanding of the 
methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students who earn 
internship credit are required to have a supervisor 
evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are adequately 
prepared in the areas of research and information 
gathering 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students adequately demonstrated an understanding of 
writing, editing and production techniques (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected froma 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the “core curriculum” material 
because the pre-test scores are lower than the post-test 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas, 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: 

Pre assessment score were 76/100. 
Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.7 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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scores (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning, but some 
information seems to be forgotten between sophomore 
and senior year 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed; 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students agree they understand 
the relevant planning and management methods 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4.3 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 





* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 





Outcome: #2 - Relevance of human diversity in mass communications 
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Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was givena 
few weeks before graduation. (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 





Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: annually. 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 

(questions 42-50) with an average of 62%. 





Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 


thinking) is assessed in four categories: 
1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
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Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 








2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 
3) if the student’s work reflected looking beyond the obvious (Excel Column F) 
A) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student's work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

A= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.85 / 5 





Timeline for Assessment: Yearly 








Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student’s critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: XX 





Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Senior Exit Survey (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 








Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/ Benchmark: Students' scores on the theory question determined students understood the theory 
Timeline for Assessment: annually 











Supervisor Evaluation - Internship supervisor evaluation (Active) 





* Learning Outcome Goal/Benchmark: xx 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column |) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.75 
Timeline for Assessment: Yearly 











Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: XX 





Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
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Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 








Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 


via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 





* Learning Outcome Goal/Benchmark: 
Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 








* Learning Outcome Goal/Benchmark: 3.7 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 





09/26/2019 Generated by Nuventive Improve Page 5 of 5 





Annual Executive Summary 
Report 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 





The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recom mend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum, 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to bea 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, multimedia journalism students demonstrated an understanding of the Learning Objectives, demonstrated proficiency 
in critical, creative and independent thinking, and demonstrated an understanding of the writing, editing, information gathering 


and production techniques. 


Dissemination of Findings 


Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 
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Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. Bobbikay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 

Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major' to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School, 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Science 
Multimedia Journalism 





Program Information Report 


Program (CAS) - SMSC - Multimedia Journalism (BS) - 477 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Information 
Assessment Coordinator's Name: Gina Noble 


Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 56 

Total Number of Students Graduated: 10 

Number of Student Graduates from Stillwater Campus: 10 

Were university assessment funds used by the department/program for assessment activities?: Yes 


Number of Student Graduates from Tulsa Campus: 0 
If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 


SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic commu nications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 


Program (CAS) - SMSC - Multimedia Journalism (BS) - 477 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation ina democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members’ interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, multimedia journalism students demonstrated an understanding of the Learning Objectives, demonstrated proficiency 
in critical, creative and independent thinking, and demonstrated an understanding of the writing, editing, information gathering 


and production techniques. 


Dissemination of Findings 


Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 


sequence head for Sports Media 
Dr. Joey Senat - sequence head for Multimedia Journalism 
Dr, BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major' to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Results indicate a good representation of the learning outcome 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer. com 

What do the findings suggest about student achievement of this learning outcome?: Results indicate a good representation of 
the learning outcome 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students | 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning as they progress through the program. 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: required exam for all capstone students 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program. 

















Outcome: #2 - Relevance of human diversity in mass communications 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications, 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Results demonstrate a good representation of understanding of the relevance of human diversity in mass communications 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students understand the importance of 
human diversity in mass communications but all faculty should continue to emphasize its importance in each class and each 
sequence 























Outcome: #3 - History and social role of mass communications. 
Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Results demonstrate a good representation of students' respect for the history and social role of mass communications. All 
faculty should emphasize the importance of history and social role in their classes. The social role can be emphasized through in- 
class speakers, etc. 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students have a good understanding 
regarding the history and social role of mass communication. 


























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 
press. 

Timeline for Assessment: annually 





Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included and emphasized in all or 
most upper-division classes 








Outcome: #4 - Critical, creative and independent thinking in mass 
communication 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


| Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
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independent thinking) is assessed in four categories: 

1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

A= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.85 / 5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated proficiency in critical, creative and independent thinking 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are adequately prepared in 
critical, creative and independent thinking, and there's always room for improvement. Improvement stems from upper-division 
courses requiring assignments that emphasize the importance of critical, creative and independent thinking. 











Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student’s critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/ Benchmark: XX 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Supervisors rated students as proficient to advanced in critical, creative and independent thinking in mass com munications 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all credit internships required supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: students are proficiently skilled in critical, 
creative and independent thinking in mass communications 








Outcome: #5 - Relevant theories and concepts of mass 
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communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Senior Exit Survey (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student results demonstrate a good representation of the understanding of relevant theories and concepts in mass 
communications 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students have a relevant understanding of 
theories and concepts in mass communications, but more theories should be added to the curriculum. 




















Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students' scores on the theory question determined students understood the 





theory 

Timeline for Assessment: annually 
Findings 

Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 
the theories 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should discuss theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 














Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: xx 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 2 - Meets Minimum Program Expectations (Developing) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to 
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something they usually don't measure...many mark it as NA instead of giving a rating. This question & measurement need to be 
reassessed. 





Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column |) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.75 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an understanding of the methods and techniques or research and information gathering 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: Randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students demonstrated an understanding 
of the methods and techniques or research and information gathering 











Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 
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* Learning Outcome Goal/Benchmark: XX 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an adequate understanding of the methods and techniques of research and information gathering. 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all students who earn internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are adequately prepared in the 
areas of research and information gathering 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

A= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students adequately demonstrated an understanding of writing, editing and production techniques 

Number of Students Assessed: 5 


Number of Successful Students: 5 
How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 





randomizer.com 
What do the findings suggest about student achievement of this learning outcome?: Students demonstrate adequate 


knowledge in writing, editing and production 








| Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students | 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 









For LO #7, questions 1-20 were counted. (Active) 
* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 














Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.7 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students agree they understand the 
relevant planning and management methods 
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Program Mission Statement: To educate 
effective communicators who facilitate and promote participation 
change through lifelong learning. Oklahoma State University Schoo 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
| of Media & Strategic Communications will do this by promoting: 








| Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication, 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment; annually 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning 
outcome (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer. com 

What do the findings suggest about student achievement 
of this learning outcome?: Results indicate a good 
representation of the learning outcome 








Comprehensive, Certification, or 
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Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program. (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required exam for all 
capstone students 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of 
understanding of the relevance of human diversity in mass 
communications (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students understand the 
importance of human diversity in mass communications but 
all faculty should continue to emphasize its importance in 
each class and each sequence 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of students’ 
respect for the history and social role of mass 
communications. All faculty should emphasize the 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 








Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 


09/26/2019 


Goal/Benchmark: Goal achieved: 
4/5 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%, 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
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importance of history and social role in their classes. The 
social role can be emphasized through in-class speakers, 
etc. (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a good 
understanding regarding the history and social role of mass 
communication. 

Reporting Period: 2018 - 2019 

Conclusion; 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?; Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
and emphasized in all or most upper-division classes 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 
accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student's work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.85 / 5 
Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated proficiency in critical, creative and 
independent thinking (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately 
prepared in critical, creative and independent thinking, and 
there's always room for improvement. Improvement stems 
from upper-division courses requiring assignments that 
emphasize the importance of critical, creative and 
independent thinking. 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
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Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


Survey - Graduating Senior Exit 
Survey 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 
/5 


Supervisors rated students as proficient to advanced in 
critical, creative and independent thinking in mass 
communications (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all credit internships 
required supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: students are proficiently skilled 
in critical, creative and independent thinking in mass 
communications 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student results demonstrate a good representation of the 
understanding of relevant theories and concepts in mass 
communications (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate inthe 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a relevant 
understanding of theories and concepts in mass 
communications, but more theories should be added to the 
curriculum. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark: Students’ scores 
on the theory question determined 
students understood the theory 
Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more 
questions should be added - faculty should focus on classes 
covering the theories (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
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#6- Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: xx 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 
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in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should discuss theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period; 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say “theories” are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...many mark it as NA 
instead of giving a rating. This question & measurement 
need to be reassessed. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an understanding of the methods 
and techniques or research and information gathering 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: Randomly selected froma 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrated an 
understanding of the methods and techniques or research 
and information gathering 
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External reviewers reviewed five 
portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale. 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.75 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
- a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an adequate understanding of the 
methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students who earn 
internship credit are required to have a supervisor 
evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are adequately 
prepared in the areas of research and information 


7 = Expertly Demonstrated gathering 
* Learning Outcome 
Goal/Benchmark: XX 
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#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column 0) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students adequately demonstrated an understanding of 
writing, editing and production techniques (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 


Reporting Period: 2018 - 2019 
Conclusion; 3 - Meets Program Expectations (Proficient) 


Generated by Nuventive Improve 


Page 80f9 








Outcomes 
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#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication, 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students In 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and Is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark; 3.7 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students agree they understand 
the relevant planning and management methods 
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Program Plan and Findings: Four Column 


Layout 


Program (CAS) - SMSC - Multimedia Journalism (BS) - 477 





Program Mission Statement: To educat 
effective communicators who facilitate and promote parti 
change through lifelong learning. Oklahoma State Universi 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


e the future leaders in mass communication from Oklahoma, 
cipation in a democratic society through excellence in practice, 
ty School of Media & Strategic Communications will do this by promoting: 


its neighboring states, the nation and the world to be responsible and 
ethical behavior, a critical stance, and embracing 








Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning 
outcome (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this autcome?: randomly selected from a 
senior list using randomizer. com 

What do the findings suggest about student achievement 
of this learning outcome?; Results indicate a good 
representation of the learning outcome 





Comprehensive, Certification, or 


Reporting Period: 2018 - 2019 
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#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program. (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required exam for all 
capstone students 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program, 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of 
understanding of the relevance of human diversity in mass 
communications (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?; all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students understand the 
importance of human diversity in mass communications but 
all faculty should continue to emphasize its importance in 
each class and each sequence 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of students’ 
respect for the history and social role of mass 
communications. Alll faculty should emphasize the 
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Outcome Status; Active 
Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 


09/26/2019 


Goal/Benchmark: Goal achieved: 
4/5 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 


importance of history and social role in their classes. The 
social role can be emphasized through in-class speakers, 
etc. (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a good 
understanding regarding the history and social role of mass 
communication. 

Reporting Period: 2018 - 2019 

Conclusion: 1- Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
and emphasized in all or most upper-division classes 


Reporting Period: 2018 - 2019 
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independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 
accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student's work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student’s work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.85 / 5 
Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated proficiency in critical, creative and 
independent thinking (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately 
prepared in critical, creative and independent thinking, and 
there's always room for improvement. Improvement stems 
from upper-division courses requiring assignments that 
emphasize the importance of critical, creative and 
independent thinking. 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
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#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
rate the work ona 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


Survey - Graduating Senior Exit 
Survey 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 


/5 


Supervisors rated students as proficient to advanced in 
critical, creative and independent thinking in mass 
communications (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all credit internships 
required supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: students are proficiently skilled 
in critical, creative and independent thinking in mass 
communications 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student results demonstrate a good representation of the 
understanding of relevant theories and concepts in mass 
communications (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a relevant 
understanding of theories and concepts in mass 
communications, but more theories should be added to the 
curriculum. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark; Students’ scores 
on the theory question determined 
students understood the theory 
Timeline for Assessment: annually 





Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more 
questions should be added - faculty should focus on classes 
covering the theories (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
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Supervisor Evaluation - Internship 
supervisor evaluation 
* Learning Outcome 


Goal/Benchmark: xx 
#6- Methods and techniques of Portfolio Review - In the External 
research and information gathering - Reviewers Portfolio assessment, 
Students will demonstrate an Learning Outcome #6 assessed if the 
understanding of the methods and students’ work showed evidence for 
techniques of research and 1) the ability to gather information 
information gathering. effectively and competently (Excel 
Outcome Status: Active Column H) 
Planned Assessment Year: 2018 - 2) initiative and creativity in 
2019 information gathering (Excel Column 


1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should discuss theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students, Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...many mark it as NA 
instead of giving a rating. This question & measurement 
need to be reassessed. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an understanding of the methods 
and techniques or research and information gathering 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: Randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrated an 
understanding of the methods and techniques or research 
and information gathering 
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External reviewers reviewed five 
portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale, 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.75 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
- a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


09/26/2019 
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Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an adequate understanding of the 
methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students who earn 
internship credit are required to have a supervisor 


evaluation 
What do the findings suggest about student achievement 


of this learning outcome?: students are adequately 
prepared in the areas of research and information 
gathering 
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#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year; 2018 - 
2019 


09/26/2019 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column 0) 


External reviewers reviewed 8 
portfolios and received two links; 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student’s work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark; 3.9 
Timeline for Assessment: Yearly 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 


Generated by Nuventive Improve 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students adequately demonstrated an understanding of 
writing, editing and production techniques (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 





Reporting Period; 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class, Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times, The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100, 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation, 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.7 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication, 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students agree they understand 
the relevant planning and management methods 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Arts 
Strategic Communication 





Program Information Report 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Information 

Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 68 

Total Number of Students Graduated: 19 

Number of Student Graduates from Stillwater Campus: 19 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jabs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members’ interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to bea 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media. Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society. 
This also indicates that the curriculum should include more emphasis on the social role of mass comm/media through course 
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content readings, class discussions, assignments and in-class speakers, The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 


















Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 


In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world. Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


The 2018-19 SMSC Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i,e., 62 vs. 
74 percent). However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements 
in three of the four core courses, Those scores indicate students are learning many key concepts. In contrast, averages related to 
Media in a Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the 
pretest. However, this was only the second time both tests were administered in the same academic year so making any 
statement about the overarching effectiveness of teaching based on test results is difficult. 





The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media. Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society, 
This also indicates that the curriculum should include more emphasis on the social role of mass comm/media through course 
content readings, class discussions, assignments and in-class speakers. The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 





Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 





In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world. Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


Overall, strategic communication students demonstrate a good to outstanding understanding of the Learning objectives, critical 
and creative thinking and writing and editing techniques. 


Dissemination of Findings 


Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 


sequence head for Sports Media 
Dr. Joey Senat - sequence head for Multimedia Journalism 
Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major' to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Graduating seniors agreed strongly to understanding constitutional freedoms & legal and ethical principles 

Number of Students Assessed: 34 

Number of Successful Students: 34 

How were students selected to participate in the assessment of this outcome?: every graduating senior was invited to 
participate in an online survey 

What do the findings suggest about student achievement of this learning outcome?: Students are learning and retaining 
constitutional freedoms & legal and ethical principles information 

















i Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program 








| 
Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 





Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online “exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: 4.3 /5 
Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, 
which would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for 
diversity in mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are confident in their learning of human diversity in mass communication 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 
through the program 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: 4 /5 

Goal achieved. 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and role of mass communication, but this is one area where measurement could be expanded. 
Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 
in an online exit survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 


through the program. 















Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 





press. 
Timeline for Assessment: annually 
Findings 
Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 86 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 

Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 
Outcome Status: Active 


Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student's work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers agree students are demonstrating critical, creative and independent thinking in mass communication. 
However, this is hard to access in some digital artifacts. What else can be done to measure creative and independent thinking? 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students proficiently demonstrate critical, 
creative and independent thinking in mass communication 











Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors agreed strongly that students’ perform well in critical, creative and independent thinking in mass 
communication 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: students enrolled in internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are meeting and exceeding 
professionals expectations regarding critical, creative and independent thinking in mass communication 











Outcome: #5 - Relevant theories and concepts of mass 
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communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Seniors Exit Survey (Active) 


* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 


mass media and communications. 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

Seniors agree they understand the relevant theories and concepts of mass communication 
Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 
in an online exit survey 

What do the findings suggest about student achievement of this learning outcome?: students are exposed to and learning 
relevant communication theories, but more could be done by faculty to focus on which theories are presented in which classes to 


expose the students to same theories across the program 













09/20/2019 








Comprehensive, Certification, or Professional Exam(s) - Pre and post test (Active) 
* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication theory 














Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 
the theories 

Number of Students Assessed: 140 


Number of Successful Students: 140 
How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 


capstone class and all students enrolled in Media Style & Structure 
What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 


09/20/2019 








Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - 
meaning theories were not a part of the learning achieved through internship. 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations (Developing) 
While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 


"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 41 

Number of Successful Students: 41 








09/20/2019 
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How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 


required to receive an internship supervisor evaluation 
What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 


they usually don't measure...and rating students well 





Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 








External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers believe students have skills pertaining to information gathering 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: From a graduating senior student list, five 
seniors were selected randomly via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Plus, measuring informational gathering skills is difficult. 





09/20/2019 








Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
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6 = Demonstrated Well 
7 = Expertly Demonstrated (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Internship supervisors agree students are well equipped with research and information gathering skills 


Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: Required for all credit internships 
What do the findings suggest about student achievement of this learning outcome?: Students are skilled in information 
gathering and other research skills 

















Outcome: #7 - Writing, editing and procucnon techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey, Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 





(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4 / 5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are proficient in writing but can do more to showcase their skills - students need to include many types of work in their 
digital portfolios. 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: sample selected from randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students have proficient writing skills but 
need to showcase them across more platforms and in different ways. Students should have a lot of samples in their portfolios. 
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Program (CAS) - SMSC - Strategic Communication (BA) - 476 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class, Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 










For LO #7, questions 1-20 were counted. (Active) 


* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100, 








Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 

Students will demonstrate an understanding of relevant planning and management methods in mass Zanamhunteation. 

Outcome Status: Active 


Planned Assessment Year: 2018 - 2019 


Assessment Methods 











Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Students strongly agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online "exit" survey 

What do the findings suggest about student achievement of this learning outcome?: students are comfortable in their skills and 
knowledge of planning and management 
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Program Plan and Findings: Four Column 
Layout 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
effective communicators who facilitate and promote participation in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
change through lifelong learning. Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











Outcomes Assessment Methods Findings Use of Findings (Actions) 
#1 - Understanding constitutional Survey - Graduating seniors were Reporting Period: 2018 - 2019 
freedoms & legal and ethical asked to complete an online “exit” Conclusion: 4 - Exceeds Program Expectations (Advanced) 
principles - Students will demonstrate survey regarding Learning Graduating seniors agreed strongly to understanding 
an appreciation of the constitutional Outcomes. The survey was given a constitutional freedoms & legal and ethical principles 
freedoms, legal issues and ethical few weeks before graduation. (09/20/2019) 
principles involved in mass * Learning Outcome Number of Students Assessed: 34 
communication. Goal/Benchmark: Goal achieved: 4.6 Number of Successful Students: 34 
Outcome Status: Active /5 How were students selected to participate in the 
Planned Assessment Year: 2018 - The goal was to receive a mean assessment of this outcome?: every graduating senior was 
2019 score of at least 4 (out of 5) on each invited to participate in an online survey 
question in the senior exit survey, What do the findings suggest about student achievement 
which would indicate graduating of this learning outcome?: Students are learning and 
seniors “agree” they understand and retaining constitutional freedoms & legal and ethical 
have learned a lot about the principles information 


relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 


09/26/2019 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was givena 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark; 4.3 / 5 

Goal achieved. The goal was to 
receive a mean score of at least 4 
(out of 5) on each question in the 
senior exit survey, which would 
indicate graduating seniors “agree” 
they understand and have learned a 
lot about the relevance and need for 
diversity in mass media and 
communications, 

Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation, Question #3 measured 
history and social role. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning information required in the core 
classes. (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are confident in their learning of human diversity 
in mass communication (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students; 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the history and role of mass 
communication, but this is one area where measurement 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 


09/26/2019 


* Learning Outcome 
Goal/Benchmark: 4/5 

Goal achieved. 

Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class, 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 


could be expanded. (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
asked to participate in an online exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program. 

Reporting Period: 2018 - 2019 

Conclusion: 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too “trivial” in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 86 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
External reviewers agree students are demonstrating 
critical, creative and independent thinking in mass 
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Outcomes 


Assessment Methods Findings Use of Findings (Actions)| 





independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


is assessed in four categories: communication, However, this is hard to access in some 
1) if the student's work reflected the digital artifacts. What else can be done to measure creative 
ability to analyze complex situations and independent thinking? (09/20/2019) 


accurately (Excel Column D) Number of Students Assessed; 5 

2) if the student was able to craft Number of Successful Students: 5 

innovative solutions to difficult How were students selected to participate in the 
problems (Excel Column E) assessment of this outcome?: randomly selected via 

3) if the student's work reflected randomizer.com 

looking beyond the obvious (Excel What do the findings suggest about student achievement 
Column F) of this learning outcome?: Students proficiently 

4) if the student had the ability to demonstrate critical, creative and independent thinking in 
effectively communicate complex mass communication 


ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Gval/Benchmark: Goal achieved - 
4.2 out of five, which exceeds the 
goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship Reporting Period: 2018 - 2019 
Supervisor Evaluation assessment Conclusion: 4 - Exceeds Program Expectations (Advanced) 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: The average 
ranking was 6.3 / 7, which exceeds 
the goal of 6. 


Survey - Graduating Seniors Exit 
Survey 

* Learning Outcome 
Goal/Benchmark:; Goal achieved - 
4.2/5. 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 


Internship supervisors agreed strongly that students' 
perform well in critical, creative and independent thinking 
in mass communication (09/20/2019) 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: students enrolled in 
internship credit are required to have a supervisor 
evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are meeting and 
exceeding professionals expectations regarding critical, 
creative and independent thinking in mass communication 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Seniors agree they understand the relevant theories and 
concepts of mass communication (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
asked to participate in an online exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are exposed to and 
learning relevant communication theories, but more could 
be done by faculty to focus on which theories are presented 
in which classes to expose the students to same theories 
across the program 





Comprehensive, Certification, or 
Professional Exam(s) - Pre and post 
test 

* Learning Outcome 
Goal/Benchmark: Posttest scores 
demonstrated an understanding of 
the mass communication theory 


Reporting Period: 2018 - 2019 i 
Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more 
questions should be added - faculty should focus on classes 
covering the theories (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
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Outcomes Assessment Methods Findings Use of Findings (Actions) | 


assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 
What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Supervisor Evaluation - Internship Reporting Period: 2018 - 2019 





supervisor evaluation Conclusion: 2 - Meets Minimum Program Expectations 
* Learning Outcome (Developing) 

Goal/Benchmark: Goal achieved-6 While the internship supervisor's rated students as 

out of 7. Many supervisor achieving the goal, the measurement could be stronger. 


evaluations stated "not applicable"- | Most supervisors say "theories" are not applicable to the 
meaning theories were not a part of internship job - they are just checking a box to help the 
the learning achieved through students, Where else can this outcome be measured? 
internship. (09/20/2019) 
Number of Students Assessed: 41 
Number of Successful Students: 41 
How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 
What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...and rating students 


well 

#6 - Methods and techniques of Portfolio Review - In the External Reporting Period: 2018 - 2019 
research and information gathering- Reviewers Portfolio assessment, Conclusion: 3 - Meets Program Expectations (Proficient) 
Students will demonstrate an Learning Outcome #6 assessed ifthe External reviewers believe students have skills pertaining to 
understanding of the methods and students’ work showed evidence for information gathering (09/20/2019) 
techniques of research and 1) the ability to gather information Number of Students Assessed: 5 
information gathering. effectively and competently (Excel © Number of Successful Students: 5 
Outcome Status: Active Column H) How were students selected to participate in the 
Planned Assessment Year: 2018 - 2) initiative and creativity in assessment of this outcome?: From a graduating senior 
2019 information gathering (Excel Column student list, five seniors were selected randomly via 

1) randomizer.com 

3) use multiple methods and sources What do the findings suggest about student achievement 

for research (Excel Column J) of this learning outcome?: External reviewers believe 


4) to effectively communicate how students are proficient in information gathering. Plus, 
the information was gathered (Excel measuring informational gathering skills is difficult. 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





09/26/2019 


Column K) 


External reviewers reviewed five 
portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale. 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4.1/5 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 


Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Internship supervisors agree students are well equipped 
with research and information gathering skills (09/20/2019) 
Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: Required for all credit 
internships d 

What do the findings suggest about student achievement 
of this learning outcome?: Students are skilled in 
information gathering and other research skills 
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Assessment Methods 


Findings Use of Findings (Actions)| 








#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


* Learning Outcome 
Goal/Benchmark: Goal achieved - 
6.2 out of 7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 


Goal/Benchmark: Goal achieved: 4 / 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are proficient in writing but can do more to 
showcase their skills - students need to include many types 
of work in their digital portfolios. (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome? sample selected from 
randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students have proficient writing 
skills but need to showcase them across more platforms 
and in different ways. Students should have a lot of samples 
in their portfolios. 
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Findings Use of Findings (Actions)| 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


5 

Timeline for Assessment: Yearly 
Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.6 
[Ss 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Students strongly agree they understand the relevant 
planning and management methods in mass 
communication. (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online "exit" survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are comfortable in 
their skills and knowledge of planning and management 
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mass media and communications. 
Timeline for Assessment: Yearly 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was givena 
few weeks before graduation. (Active) 













* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 /5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 
Timeline for Assessment: annually 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking | 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 











Outcome: #2 - Relevance of human diversity in mass communications 
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Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 
























* Learning Outcome Goal/Benchmark: 4.3 /5 
Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which 
would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 





Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications, 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 
* Learning Outcome Goal/Benchmark: 4/5 
Goal achieved. 
Timeline for Assessment: annually. 





























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 

(questions 42-50) with an average of 62%. 





Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 











Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 








thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student's work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 





Timeline for Assessment: Yearly 








Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student's critical, creative and independent thinking / work and rate the work ona 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 


* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 








Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Seniors Exit Survey (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 








Comprehensive, Certification, or Professional Exam(s) - Pre and post test (Active) 





* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication theory 








Supervisor Evaluation - Internship supervisor evaluation (Active) ] 
* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - 
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| meaning theories were not a part of the learning achieved through internship. | 





Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column I) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 











Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 





Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: Yearly 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 





* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was givena 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 
Timeline for Assessment: Yearly 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Science 
Strategic Communication 





Program Information Report 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 
Program Information 


Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 182 

Total Number of Students Graduated: 76 

Number of Student Graduates from Stillwater Campus: 76 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2020 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts, In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media. Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society. 
This also indicates that the curriculum should include more emphasis on the social role of mass comm/media through course 
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content readings, class discussions, assignments and in-class speakers. The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 


Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 


In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world. Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


The 2018-19 SMSC Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 
74 percent). However, the averages were higher than the previous year's scores (50 vs. 67 percent) and showed improvements 
in three of the four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to 
Media in a Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the 
pretest. However, this was only the second time both tests were administered in the same academic year so making any 
statement about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to bea 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know, 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media, Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society. 
This also indicates that the curriculum should include more emphasis on the social role of mass com m/media through course 
content readings, class discussions, assignments and in-class speakers. The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 


Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 


In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world, Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


Overall, strategic communication students demonstrate a good to outstanding understanding of the Learning objectives, critical 
and creative thinking and writing and editing techniques. 


Dissemination of Findings 

Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 

Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: sequence heads, program director 
and associate director send results to all faculty members and discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major’ to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes but may have to ask 
fewer external reviewers to assess each sequence because funding was cut by half this year. Our external reviewers are the 
strongest 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Revised Assessment Plan, Improved 
Faculty Understanding or Buy-In 

Goals for the Coming Year: Sequence heads must replace pre-post test questions; internship supervisor revised questions - 
learning outcome #5 eliminated or replaced 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Graduating seniors agreed strongly to understanding constitutional freedoms & legal and ethical principles 

Number of Students Assessed: 34 

Number of Successful Students: 34 

How were students selected to participate in the assessment of this outcome?: every graduating senior was invited to 
participate in an online survey 

What do the findings suggest about student achievement of this learning outcome?: Students are learning and retaining 
constitutional freedoms & legal and ethical principles information 
































kina Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program 








Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: 4.3 / 5 
Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, 
which would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for 
diversity in mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are confident in their learning of human diversity in mass communication 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 


online survey 
What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 


through the program 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role, (Active) 

* Learning Outcome Goal/Benchmark: 4/5 

Goal achieved. 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and role of mass communication, but this is one area where measurement could be expanded. 
Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 
in an online exit survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 
through the program. 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 





press. 
Timeline for Assessment: annually 
Findings 
Reporting Period: 2018 - 2019 09/15/2019 


Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 








Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Findings 
Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers agree students are demonstrating critical, creative and independent thinking in mass communication. 
However, this is hard to access in some digital artifacts. What else can be done to measure creative and independent thinking? 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students proficiently demonstrate critical, 
creative and independent thinking in mass communication 


























Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors agreed strongly that students’ perform well in critical, creative and independent thinking in mass 
communication 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: students enrolled in internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are meeting and exceeding 
professionals expectations regarding critical, creative and independent thinking in mass communication 











Outcome: #5 - Relevant theories and concepts of mass 
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communication 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Senior Exit Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning 
Outcomes. The survey was given a few weeks before graduation. Question #4 measured relevant theories. (Active) 


* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 /5. 





The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Seniors agree they understand the relevant theories and concepts of mass communication 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 


in an online exit survey 
What do the findings suggest about student achievement of this learning outcome?: students are exposed to and learning 
relevant communication theories, but more could be done by faculty to focus on which theories are presented in which classes to 


expose the students to same theories across the program 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Exam (Active) 
* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication 
theory. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 
the theories 

Number of Students Assessed: 140 


Number of Successful Students: 140 
How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 


capstone class and all students enrolled in Media Style & Structure 
What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 


in subsequent classes / more questions written for theory on pre-post exam 






















Supervisor Evaluation - Internship Supervisors were asked to evaluate the student’s understanding of relevant theories 
and concepts in mass communication and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 
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* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - 
meaning theories were not a part of the learning achieved through internship. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 2 - Meets Minimum Program Expectations (Developing) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure...many mark it as NA instead of giving a rating 











Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column !) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers believe students have skills pertaining to information gathering 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: From a graduating senior student list, five 
seniors were selected randomly via randomizer.com 
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What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Note... measuring informational gathering skills is difficult. 








Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Reviewers agreed students understood and demonstrated the methods and techniques of research and information gathering. 
Number of Students Assessed: 41 


Number of Successful Students: 41 
How were students selected to participate in the assessment of this outcome?: all students who earn internship credit are 


required to have a supervisor evaluation 
What do the findings suggest about student achievement of this learning outcome?: students are well prepared in the areas of 


research and information gathering 








Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors agree students are well equipped with research and information gathering skills 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: Required for all credit internships 

What do the findings suggest about student achievement of this learning outcome?: Students are adequately skilled in 
information gathering and other research skills 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
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survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 
1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are proficient in writing but can do more to showcase their skills - students need to include many types of work in their 
digital portfolios. 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: sample selected from randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students have proficient writing skills but 
need to showcase them across more platforms and in different ways. Students should have a lot of samples in their portfolios. 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 


* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic commu nication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 

Students will demonstrate an understanding of relevant planning and management methods in mass communication. 

Outcome Status: Active 


Planned Assessment Year: 2018 - 2019 


Assessment Methods 


[ Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
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given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 











Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Students strongly agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online "exit" survey 

What do the findings suggest about student achievement of this learning outcome?: students are comfortable in their skills and 
knowledge of planning and management 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring stat 
effective communicators who facilitate and promote participation i 
change through lifelong learning. Oklahoma State University Schoo 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


n a democratic society through excellence in practice, 
lof Media & Strategic Communications will do this by promoting: 


es, the nation and the world to be responsible and 
ethical behavior, a critical stance, and embracing 








Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.6 
/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Graduating seniors agreed strongly to understanding 
constitutional freedoms & legal and ethical principles 
(09/20/2019) 

Number of Students Assessed: 34 

Number of Successful Students: 34 

How were students selected to participate in the 
assessment of this outcome?: every graduating senior was 
invited to participate in an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning and 
retaining constitutional freedoms & legal and ethical 
principles information 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#2- Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 


09/26/2019 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas, 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: 4.3/5 

Goal achieved. The goal was to 
receive a mean score of at least 4 
(out of 5) on each question in the 
senior exit survey, which would 
indicate graduating seniors “agree” 
they understand and have learned a 
lot about the relevance and need for 
diversity in mass media and 
communications. 

Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning information required in the core 
classes. (09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are confident in their learning of human diversity 
in mass communication (09/15/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students understand the history and role of mass 
communication, but this is one area where measurement 
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Outcomes 


Assessment Methods Findings 


Use of Findings (Actions)| 

















communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 


2019 


#4 - Critical, creative and 


independent thinki 


ng in mass 


communication - Students will 


demonstrate critica 


09/26/2019 


|, creative and 


could be expanded. (09/15/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to participate in an online exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program. 

Reporting Period: 2018 - 2019 

Conclusion: 1- Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too “trivial” in nature by the committee. 


* Learning Outcome 
Goal/Benchmark: 4/5 

Goal achieved. 

Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times, The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


(09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 

Many questions were deemed trivia 

by the committee, and questions 

need to be replaced. Questions need 

to better reflect assessing student 

learning in key areas under the 

history of mass communications and 

the importance of a free press. 

Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
External reviewers agree students are demonstrating 
critical, creative and independent thinking in mass 


Portfolio Review -!n the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 


Generated by Nuventive Improve 


Questions must be replaced before the next testing session. 


Page 3 of 10 











Outcomes 


Assessment Methods Findings i Use of Findings (Actions)| 





independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


is assessed in four categories: communication. However, this is hard to access in some 
1) if the student’s work reflected the digital artifacts. What else can be done to measure creative 
ability to analyze complex situations and independent thinking? (09/15/2019) 


accurately (Excel Column D) Number of Students Assessed: 5 

2) if the student was able to craft Number of Successful Students: 5 

innovative solutions to difficult How were students selected to participate in the 
problems (Excel Column E) assessment of this outcome?: randomly selected via 

3) if the student's work reflected randomizer.com 

looking beyond the obvious (Excel What do the findings suggest about student achievement 
Column F) of this learning outcome?: Students proficiently 

4) if the student had the ability to demonstrate critical, creative and independent thinking in 
effectively communicate complex mass communication 


ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links; 1) 
a link to a student portfolio, and 2) a 
link to an online survey, Each 
reviewer was asked to review the 
student’s work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved - 
4,2 out of five, which exceeds the 
goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship Reporting Period: 2018 - 2019 
Supervisor Evaluation assessment Conclusion: 4 - Exceeds Program Expectations (Advanced) 
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survey (see Appendix) - Internship Internship supervisors agreed strongly that students’ 
Supervisors were asked to assess the perform well in critical, creative and independent thinking 
student's critical, creative and in mass communication (09/15/2019) 

independent thinking / work and Number of Students Assessed: 41 

rate the work on a 7-point-scale. Number of Successful Students: 41 

1 = Not Applicable How were students selected to participate in the 

2 = Understanding Not assessment of this outcome?: students enrolled in 
Demonstrated internship credit are required to have a supervisor 

3 = Demonstrated Only Slightly evaluation 

4 = Demonstrated Occasionally What do the findings suggest about student achievement 
5 = Demonstrated But Needs Work Of this learning outcome?: students are meeting and 

6 = Demonstrated Well exceeding professionals expectations regarding critical, 

7 = Expertly Demonstrated creative and independent thinking in mass communication 


* Learning Outcome 
Goal/Benchmark: The average 
ranking was 6.3 / 7, which exceeds 


the goal of 6. 

#5 - Relevant theories and concepts Survey - Senior Exit Survey - Reporting Period: 2018 - 2019 

of mass communication - Students Graduating seniors were asked to Conclusion: 3 - Meets Program Expectations (Proficient) 

will demonstrate an understanding of complete an online "exit" survey Seniors agree they understand the relevant theories and 

the relevant theories and concepts of regarding Learning Outcomes. The concepts of mass communication (09/15/2019) 

mass communication. survey was given a few weeks before Number of Students Assessed: 33 

Outcome Status: Active graduation. Question #4 measured Number of Successful Students: 33 

Planned Assessment Year: 2018 - relevant theories. How were students selected to participate in the 

2019 * Learning Outcome assessment of this outcome?: all graduating seniors were 
Goal/Benchmark: Goal achieved - asked to participate in an online exit survey 
4.2/5. What do the findings suggest about student achievement 

of this learning outcome?: students are exposed to and 

The goal was to receive a mean learning relevant communication theories, but more could 
score of at least 4 (out of 5) on each be done by faculty to focus on which theories are presented 
question in the senior exit survey, in which classes to expose the students to same theories 
which would indicate graduating across the program 


seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 





Comprehensive, Certification, or Reporting Period: 2018 - 2019 
Professional Exam(s) - Pre-Post Conclusion: 3 - Meets Program Expectations (Proficient) 
Exam One question in the pre-post exam deals with theory - more 
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Assessment Methods 


Findings 


Use of Findings (Actions) 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 


09/26/2019 


* Learning Outcome 
Goal/Benchmark: Posttest scores 
demonstrated an understanding of 
the mass communication theory. 


Supervisor Evaluation - Internship 
Supervisors were asked to evaluate 
the student’s understanding of 
relevant theories and concepts in 
mass communication and rate the 
work ona 7-point-scale, 

1 =Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: Goal achieved - 6 
out of 7. Many supervisor 
evaluations stated "not applicable" - 
meaning theories were not a part of 
the learning achieved through 
internship. 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 


questions should be added - faculty should focus on classes 
covering the theories (09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/15/2019) 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure... many mark it as NA 
instead of giving a rating 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
External reviewers believe students have skills pertaining to 
information gathering (09/15/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
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Planned Assessment Year: 2018 - 
2019 


09/26/2019 


2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale, 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4.1/5 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work on a 7-point-scale. 
1 = Not Applicable 


assessment of this outcome?: From a graduating senior 
student list, five seniors were selected randomly via 
randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: External reviewers believe 
students are proficient in information gathering. Note... 
measuring informational gathering skills is difficult. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Reviewers agreed students understood and demonstrated 
the methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 
2 = Understanding Not assessment of this outcome?: all students who earn 
Demonstrated internship credit are required to have a supervisor 


#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 =Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: Goal achieved - 
6.2 out of 7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey, Each 
reviewer was asked to review the 
student’s work and rate the work on 


evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are well prepared in 
the areas of research and information gathering 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Internship supervisors agree students are well equipped 
with research and information gathering skills (09/15/2019) 
Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: Required for all credit 
internships 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately skilled 
in information gathering and other research skills 





Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students are proficient in writing but can do more to 
showcase their skills - students need to include many types 
of work in their digital portfolios. (09/15/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: sample selected from 
randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students have proficient writing 
skills but need to showcase them across more platforms 
and in different ways. Students should have a lot of samples 
in their portfolios. 
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#8 = Relevant planning and 
management methods in mass 


09/26/2019 


a 5-point-scale, 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

Timeline for Assessment; Yearly 
Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year, 


Reporting Period: 2018 - 2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 
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communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication, 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.6 
/5. 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Students strongly agree they understand the relevant 
planning and management methods in mass 
communication. (09/15/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online "exit" survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are comfortable in 
their skills and knowledge of planning and management 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 











Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 /5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 
































Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 





* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 





Outcome: #2 - Relevance of human diversity in mass communications 
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Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 








* Learning Outcome Goal/Benchmark: 4.3 /5 

Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which 
would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 





Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 
* Learning Outcome Goal/Benchmark: 4 / 5 


Goal achieved. 
Timeline for Assessment: annually. 






































Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 








Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 
Timeline for Assessment: annually 








Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 
thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 





Timeline for Assessment: Yearly 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 


* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 








Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Senior Exit Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The 
survey was given a few weeks before graduation. Question #4 measured relevant theories. (Active) 














* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 / 5. 


The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Exam (Active) 








* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication theory. 
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Supervisor Evaluation - Internship Supervisors were asked to evaluate the student’s understanding of relevant theories and 
concepts in mass communication and rate the work ona 7-point-scale, 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - meaning 
theories were not a part of the learning achieved through internship. 











Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 








External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 

















Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 














* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 
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Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: Yearly 























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 











* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 
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* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 
Timeline for Assessment: Yearly 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Arts 
Sports Media 





Program Information Report 


Program (CAS) - SMSC - Sports Media (BA) - 479 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 

















2018 - 2019 
Program Information 


Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 30 

Total Number of Students Graduated: 11 

Number of Student Graduates from Stillwater Campus: 11 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum, 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, sports media students demonstrated an understanding of the Learning Objectives, demonstrated a good representation 
of critical, creative and independent thinking, and demonstrated an understanding of the writing, editing and production 
techniques. 

Dissemination of Findings 

Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 

Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major’ to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Sports Media (BA) - 479 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Results represent a good representation of the learning outcome. All faculty should emphasize constitutional freedoms as well as 
relevant legal issues and ethical principles in their courses 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to take an 
exit survey 

What do the findings suggest about student achievement of this learning outcome?: Graduates demonstrate an appreciation of 
the constitutional freedoms, legal issues and ethical principles involved in mass communication. 
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Comprehensive, Certification, or Professional Exam/(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning and retaining information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students have an appreciation of the 
constitutional freedoms, legal issues and ethical principles involved in mass communication. 




















Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the relevance of human diversity in mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning about human 
diversity as they progress through the program 




















Outcome: #3 - History and social role of mass communications. 
Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 

role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

Goal is to score at least 4. 

Timeline for Assessment: annually. 

Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and social role of mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to participate 
in the survey 

What do the findings suggest about student achievement of this learning outcome?: Students adequately understand the 
history and social role of mass communications 



















Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class, The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 
press. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 




















Outcome: #4 - Critical, creative and independent thinking in mass 
communication 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 








independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 





(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4 /5 
Goal is 4+ 
Timeline for Assessment: Yearly 
Findings 
Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated a good representation of critical, creative and independent thinking as they relate to the field of 
sports media 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Student portfolios demonstrated a good 
representation of critical, creative and independent thinking as they relate to the field of sports media 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 6.5 / 7 











Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors said students demonstrated their critical, creative and independent as 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: Students earning internship credit must be 
evaluated by supervisors 

What do the findings suggest about student achievement of this learning outcome?: Students are skilled in critical, creative and 
independent thinking. 





Outcome: #5 - Relevant theories and concepts of mass 
communication 
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Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors exit survey (Active) 
* Learning Outcome Goal/Benchmark: 3.85 / 5 
Goal: 4/5 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students felt their coursework adequately required them to demonstrate knowledge of relevant theories and concepts of mass 
communication 

Number of Students Assessed: 7 














Number of Successful Students: 7 
How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 


survey 
What do the findings suggest about student achievement of this learning outcome?: While students felt positive about theories 
in their coursework, they need more exposure to theory. It is recommended that each sequence and the entire faculty discuss 


important theories to highlight in multiple classes. 














Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While students are proficient in identifying theories, more theory questions recommended, and faculty should select theories to 


be highlighted in multiple sequence classes. One question in the pre-post exam deals with theory. 
Number of Students Assessed: 140 


Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 


























Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: 5.6 / 7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure - many mark it as NA instead of giving a rating 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column |) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated an average to good representation of understanding of the methods and techniques used to 
gather information 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: selected from list of seniors using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Note... measuring informational gathering skills is difficult. 

















Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: 6 / 7 

Goal achieved: 
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Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Internship supervisors agree students are adequate in research and information gathering skills 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: credit internships must have supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: Students are adequate in research and 
information gathering skills, but there's always room for improvement. 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 








Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 








Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Reviewers determined that student portfolios were generally good in demonstrating an understanding of mass communications 
writing, editing and production techniques 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are proficient in writing but can 
do more to showcase their skills - students need to include many types of work in their digital portfolios. 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
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courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 
* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100, 
Post assessment scores were 83 / 100. 





Findings 
Reporting Period: 2018 - 2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 


09/20/2019 


Number of Students Assessed: 140 


Number of Successful Students: 140 
How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 


Structure and all students in strategic communication capstone classes 
What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 


information seems to be forgotten between sophomore and senior year. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.9 /5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 















mass media and communications. 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 
Number of Students Assessed: 7 


Number of Successful Students: 7 
How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 





09/20/2019 


survey 
What do the findings suggest about student achievement of this learning outcome?: students are adequate in their skills and 


knowledge of planning and management 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
effective communicators who facilitate and promote participation in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
change through lifelong learning. Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











Outcomes Assessment Methods Findings Use of Findings (Actions) | 

#1- Understanding constitutional Survey - Graduating seniors were Reporting Period: 2018 - 2019 

freedoms & legal and ethical asked to complete an online "exit" Conclusion: 4 - Exceeds Program Expectations (Advanced) 

principles - Students will demonstrate survey regarding Learning Results represent a good representation of the learning 

an appreciation of the constitutional Outcomes. The survey was given a outcome. All faculty should emphasize constitutional 

freedoms, legal issues and ethical few weeks before graduation. freedoms as well as relevant legal issues and ethical 

principles involved in mass * Learning Outcome principles in their courses (09/20/2019) 

communication. Goal/Benchmark: Goal achieved: 4.4 Number of Students Assessed: 7 

Outcome Status: Active The goal was to receive a mean Number of Successful Students: 7 

Planned Assessment Year: 2018 - score of at least 4 (out of 5)oneach How were students selected to participate in the 

2019 question in the senior exit survey, assessment of this outcome?: all graduating seniors were 
which would indicate graduating invited to take an exit survey 
seniors “agree” they understand and What do the findings suggest about student achievement 
have learned a lot about the of this learning outcome?: Graduates demonstrate an 
relevance and need for diversityin appreciation of the constitutional freedoms, legal issues 
mass media and communications. and ethical principles involved in mass communication. 


Timeline for Assessment: annually 





Comprehensive, Certification, or Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications, 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 

Outcome Status: Active 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class, Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved, 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors “exit” 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning and retaining information required in 
the core classes. (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students have an appreciation 
of the constitutional freedoms, legal issues and ethical 
principles involved in mass communication. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the relevance of human diversity in 
mass communications (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning about 
human diversity as they progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the history and social role of mass 
communications (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 
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Assessment Methods 


Findings 


Use of Findings (Actions)| 





Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication. 


09/26/2019 


Goal is to score at least 4. 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam, Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class, Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 


How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
invited to participate in the survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students adequately understand 
the history and social role of mass communications 
Reporting Period: 2018 - 2019 

Conclusion: 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised, Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session, 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated a good representation of 
critical, creative and independent thinking as they relate to 
the field of sports media (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 
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Assessment Methods 


Findings Use of Findings (Actions) 





Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


09/26/2019 


accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student’s work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

Goal is 4+ 

Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 
survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
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How were students selected to participate in the 
assessment of this outcome?: selected via randomizer,com 
What do the findings suggest about student achievement 
of this learning outcome?: Student portfolios 
demonstrated a good representation of critical, creative 
and independent thinking as they relate to the field of 
sports media 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Internship supervisors said students demonstrated their 
critical, creative and independent as (09/20/2019) 
Number of Students Assessed: 26 

Number of Successful Students: 26 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


rate the work on a 7-point-scale. 
1=Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 6.5 
/7 


Survey - Graduating seniors exit 
survey 

* Learning Outcome 
Goal/Benchmark: 3.85 / 5 
Goal: 4/5 


How were students selected to participate in the 
assessment of this outcome?: Students earning internship 
credit must be evaluated by supervisors 

What do the findings suggest about student achievement 
of this learning outcome?: Students are skilled in critical, 
creative and independent thinking. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students felt their coursework adequately required them to 
demonstrate knowledge of relevant theories and concepts 
of mass communication (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: While students felt positive 
about theories in their coursework, they need more 
exposure to theory. It is recommended that each sequence 
and the entire faculty discuss important theories to 
highlight in multiple classes. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark: Students were 
tested on one question and 
understood the theory 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While students are proficient in identifying theories, more 
theory questions recommended, and faculty should select 
theories to be highlighted in multiple sequence classes, One 
question in the pre-post exam deals with theory. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 


Generated by Nuventive Improve Page 5 of 9 








Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering, 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: 5.6 /7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 


in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?:; All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure - many mark it as NA 
instead of giving a rating 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated an average to good 
representation of understanding of the methods and 
techniques used to gather information (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: selected from list of seniors 
using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: External reviewers believe 
students are proficient in information gathering. Note... 
measuring informational gathering skills is difficult. 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





09/26/2019 


portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale, 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1= Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 =Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: 6 / 7 

Goal achieved: 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Prograrn Expectations (Proficient) 
Internship supervisors agree students are adequate in 
research and information gathering skills (09/20/2019) 
Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?: credit internships must have 
supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequate in 
research and information gathering skills, but there's 
always room for improvement. 
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#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale, 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 


Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Reviewers determined that student portfolios were 
generally good in demonstrating an understanding of mass 
communications writing, editing and production techniques 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students; 5 

How were students selected to participate in the 
assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are proficient in 
writing but can do more to showcase their skills - students 
need to include many types of work in their digital 
portfolios. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 
Exam. Students taking the first because the pre-test scores are lower than the post-test 
writing class (Media Style & scores (09/20/2019) 


#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019. 


09/26/2019 


Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100, 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.9/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are adequate in their 
skills and knowledge of planning and management 
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Program Plans: Outcomes and 
Assessment Methods 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 

















Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 


communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 




















* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 

















Outcome: #2 - Relevance of human diversity in mass communications 
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Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 




















* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 
Goal is to score at least 4. 

Timeline for Assessment: annually. 



































Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 











Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 
thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student's work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Goal is 4+ 
Timeline for Assessment: Yearly 




















Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: Goal achieved: 6.5 / 7 








Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 





Survey - Graduating seniors exit survey (Active) 











* Learning Outcome Goal/Benchmark: 3.85 / 5 
Goal: 4/5 


























Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 








* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 











Supervisor Evaluation - Internship supervisor evaluation (Active) 








* Learning Outcome Goal/Benchmark: 5.6 / 7 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 














External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 














Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: 6 / 7 
Goal achieved: 











Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
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Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 








* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 














* Learning Outcome Goal/Benchmark: 3.9 / 5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 
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Bachelor of Science 
Sports Media 





Annual Executive Summary 
Report 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, sports media students demonstrated an understanding of the Learning Objectives, demonstrated a good representation 
of critical, creative and independent thinking, and demonstrated an understanding of the writing, editing and production 
techniques. 


Dissemination of Findings 

Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 

Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major’ to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 

Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Results represent a good representation of the learning outcome. All faculty should emphasize constitutional freedoms as well as 
relevant legal issues and ethical principles in their courses 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to take an 
exit survey 

What do the findings suggest about student achievement of this learning outcome?: Graduates demonstrate an appreciation of 
the constitutional freedoms, legal issues and ethical principles involved in mass communication. 
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Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students have an appreciation of the 
constitutional freedoms, legal issues and ethical principles involved in mass communication. 














Outcome: #2 - Relevance of human diversity in mass communications 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the relevance of human diversity in mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning about human 
diversity as they progress through the program 

















Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

Goal is to score 4+ 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and social role of mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to participate 
in the survey 

What do the findings suggest about student achievement of this learning outcome?: Students adequately understand the 
history and social role of mass communications 


























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 
press. 

Timeline for Assessment: annually 








Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 


L 




















Outcome: #4 - Critical, creative and independent thinking in mass 
communication 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

A) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 











(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Goal is 4+ 
Timeline for Assessment: Yearly 
Findings 
Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated a good representation of critical, creative and independent thinking as they relate to the field of 
sports media 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Student portfolios demonstrated a good 
representation of critical, creative and independent thinking as they relate to the field of sports media 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 











Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors said students demonstrated their critical, creative and independent as 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: Students earning internship credit must be 
evaluated by supervisors 

What do the findings suggest about student achievement of this learning outcome?: Students are skilled in critical, creative and 
independent thinking. 











Outcome: #5 - Relevant theories and concepts of mass 
communication 
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Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors exit survey (Active) 
* Learning Outcome Goal/Benchmark: Goal not achieved: 3.85 
Goal is 4+ 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students felt their coursework adequately required them to demonstrate knowledge of relevant theories and concepts of mass 
communication 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: While students felt positive about theories 
in their coursework, they need more exposure to theory. It is recommended that each sequence and the entire faculty discuss 
important theories to highlight in multiple classes. 




















































Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 


Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While students are proficient in identifying theories, more theory questions recommended, and faculty should select theories to 
be highlighted in multiple sequence classes. One question in the pre-post exam deals with theory. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 
























Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: 5.6 /7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure - many mark it as NA instead of giving a rating 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated an average to good representation of understanding of the methods and techniques used to 
gather information 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Note... measuring informational gathering skills is difficult. 























Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: 5.6 / 7 


Findings 
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Program (CAS) - SMSC - Sports Media (BS) - 480 





Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Internship supervisors agree students are adequate in research and information gathering skills 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: credit internships must have supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: Students are adequate in research and 
information gathering skills, but there's always room for improvement. 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 



























External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Reviewers determined that student portfolios were generally good in demonstrating an understanding of mass communications 
writing, editing and production techniques 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are proficient in writing but can 
do more to showcase their skills - students need to include many types of work in their digital portfolios. 


























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
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Program (CAS) - SMSC - Sports Media (BS) - 480 





times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted, (Active) 
* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.95 / 5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: students are adequate in their skills and 
knowledge of planning and management 
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Program Plan and Findings: Four Column 
Layout 


Program (CAS) - SMSC - Sports Media (BS) - 480 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
effective communicators who facilitate and promote participation in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
change through lifelong learning. Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 














Adaptability 
Problem solving skills 
Diversity 
Leadership 
Community involvement 

| Outcomes Assessment Methods Findings Use of Findings (Actions) 
#1 - Understanding constitutional Survey - Graduating seniors were Reporting Period: 2018 - 2019 
freedoms & legal and ethical asked to complete an online "exit" Conclusion: 4 - Exceeds Program Expectations (Advanced) 
principles - Students will demonstrate survey regarding Learning Results represent a good representation of the learning 
an appreciation of the constitutional Outcomes. The survey was givena outcome. All faculty should emphasize constitutional 
freedoms, legal issues and ethical few weeks before graduation. freedoms as well as relevant legal issues and ethical 
principles involved in mass * Learning Outcome principles in their courses (09/20/2019) 
communication. Goal/Benchmark: Goal achieved: 4.4 Number of Students Assessed: 7 
Outcome Status: Active The goal was to receive a mean Number of Successful Students: 7 
Planned Assessment Year: 2018 - score of at least 4 (out of 5) on each How were students selected to participate in the 
2019 question in the senior exit survey, assessment of this outcome?; all graduating seniors were 

which would indicate graduating invited to take an exit survey 


seniors “agree” they understand and What do the findings suggest about student achievement 
have learned a lot about the of this learning outcome?: Graduates demonstrate an 
relevance and need for diversity in appreciation of the constitutional freedoms, legal issues 


mass media and communications, and ethical principles involved in mass communication. 


Timeline for Assessment: annually 








Comprehensive, Certification, or Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications, - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 

Outcome Status: Active 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas, 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes, The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved; 4.1 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4,1 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning information required in the core 
classes, (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students have an appreciation 
of the constitutional freedoms, legal issues and ethical 
principles involved in mass communication. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the relevance of human diversity in 
mass communications (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning about 
human diversity as they progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the history and social role of mass 
communications (09/20/2019) 

Number of Students Assessed; 7 

Number of Successful Students: 7 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication, 


09/26/2019 


Goal is to score 4+ 
Timeline for Assessment: annually, 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced, Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories; 

1) if the student’s work reflected the 
ability to analyze complex situations 


How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
invited to participate in the survey 

What do the findings suggest about student achievement 
of this learning outcome?:; Students adequately understand 
the history and social role of mass communications 
Reporting Period: 2018 - 2019 

Conclusion: 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?; Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated a good representation of 
critical, creative and independent thinking as they relate to 
the field of sports media (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 
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Outcomes 


Assessment Methods Findings Use of Findings (Actions) 





Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


09/26/2019 


How were students selected to participate in the 
assessment of this outcome?: selected via randomizer.com 
What do the findings suggest about student achievement 
of this learning outcome?: Student portfolios 
demonstrated a good representation of critical, creative 
and independent thinking as they relate to the field of 
sports media 


accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student's work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey, Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

Goal is 4+ 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisor Evaluation assessment Conclusion: 4 - Exceeds Program Expectations (Advanced) 
survey (see Appendix) - Internship Internship supervisors said students demonstrated their 
Supervisors were asked to assess the critical, creative and independent as (09/20/2019) 
student's critical, creative and Number of Students Assessed: 26 

independent thinking / work and Number of Successful Students: 26 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


rate the work ona 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 


Survey - Graduating seniors exit 
survey 

* Learning Outcome 
Goal/Benchmark: Goal not 
achieved; 3.85 

Goal is 4+ 


How were students selected to participate in the 
assessment of this outcome?: Students earning internship 
credit must be evaluated by supervisors 

What do the findings suggest about student achievement 
of this learning outcome?: Students are skilled in critical, 
creative and independent thinking. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students felt their coursework adequately required them to 
demonstrate knowledge of relevant theories and concepts 
of mass communication (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: While students felt positive 
about theories in their coursework, they need more 
exposure to theory. It is recommended that each sequence 
and the entire faculty discuss important theories to 
highlight in multiple classes. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark: Students were 
tested on one question and 
understood the theory 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While students are proficient in identifying theories, more 
theory questions recommended, and faculty should select 
theories to be highlighted in multiple sequence classes, One 
question in the pre-post exam deals with theory. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: 5.6 /7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 


to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students, Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure - many mark it as NA 
instead of giving a rating 


Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated an average to good 
representation of understanding of the methods and 
techniques used to gather information (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: External reviewers believe 
students are proficient in information gathering, Note... 
measuring informational gathering skills is difficult. 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 


reviewer was asked to review the 


student’s work and rate the work on 


a 5-point-scale, 
i= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 /5 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1=Not Applicable 

2 =Understanding Not 
Demonstrated 

3 =Demonstrated Only Slightly 
4=Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: 5.6 / 7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 


demonstrate an understanding of the four categories: 


09/26/2019 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Internship supervisors agree students are adequate in 
research and information gathering skills (09/20/2019) 
Number of Students Assessed; 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?: credit internships must have 
supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequate in 
research and information gathering skills, but there's 
always room for improvement. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Reviewers determined that student portfolios were 
generally good in demonstrating an understanding of mass 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 
writing, editing and production 13 communications writing, editing and production techniques 
techniques of mass communication 1) evidence of the ability to write (09/20/2019) 


specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O} 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 


Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are proficient in 
writing but can do more to showcase their skills - students 
need to include many types of work in their digital 
portfolios, 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.95 /5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?; students are adequate in their 
skills and knowledge of planning and management 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Sports Media (BS) - 480 











Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 














* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 
























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 




















Outcome: #2 - Relevance of human diversity in mass communications 
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Program (CAS) - SMSC - Sports Media (BS) - 480 





Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 






















* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

Goal is to score 4+ 

Timeline for Assessment: annually. 






























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 





Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 








Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Lae Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 





thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: Goal achieved: 4 / 5 
Goal is 4+ 
Timeline for Assessment: Yearly 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student’s critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors exit survey (Active) 


























* Learning Outcome Goal/Benchmark: Goal not achieved: 3.85 
Goal is 4+ 














Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 





* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 








Supervisor Evaluation - Internship supervisor evaluation (Active) 





* Learning Outcome Goal/Benchmark: 5.6 / 7 


i 








Outcome: #6 - Methods and techniques of research and information 
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gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 














External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 
































Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 











* Learning Outcome Goal/Benchmark: 5.6 / 7 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
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2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class, Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 








* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 




















* Learning Outcome Goal/Benchmark: 3.95 /5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 
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Program (CAS) - SMSC - Sports Media (BS) - 480 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity i 

Leadership 

Community involvement 

















|2018 - 2019 
Program Information 


Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 96 

Total Number of Students Graduated: 26 

Number of Student Graduates from Stillwater Campus: 26 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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2014 - 2015 
Annual Assessment Report 


Bachelor of Arts and Bachelor of Science 
Multimedia Journalism 





A Annual Assessment Report 
OKLAHOMA 7 


School of Media and Strategic Communications 
BA and BS in Multimedia Journalism 
2014-2015 






pe UNIVERSITY. 
= 


Date: September 15, 2015 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 


Assessment Coordinator’s email: bobbikay.lewis@okstate.edu 
Number of students enrolled in the program 2014-15: 134 
Number of students graduated in 2014-15: 34 





B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 
states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 





Oklahoma State University School of Media and Strategic Communications will do this 


by promoting: 
e Critical thinking 
e Creativity 


e Global awareness 

e Appreciation for the liberal arts 
e Adaptability 

¢ Problem solving skills 

e Diversity 

e Leadership 

e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 
assessment activities? [] Yes ANo 
If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 








D. Assessed Student Learning Outcomes 





Like the 2013-14 assessment, this assessment cycle only three learning outcomes were 
assessed because the students’ capstone online portfolios were used for assessment. 
However, after the 2012-13 assessment it was decided that portfolios lend themselves 
best to assess these three learning outcomes and that other criteria should be used to 
assess the other, more theoretical learning outcomes. A new plan to assess the other 
learning outcomes was to be developed for this year. Due to a change in leadership, the 
assessment plan was not restructured to address the other outcomes. A new 
assessment plan will be developed during the 2015-16 academic year, and the 2015-16 
report will reflect the new plan. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they 
relate to individual disciplines in mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of 
research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Assessment method used: 


Two assessment methods were used to evaluate all eight learning outcomes: one at the 
intermediate level and one at the advanced level. 


At the intermediate level the assessment reports of 5 students’ internship advisers were 
collected and data analyzed. Student internships are evaluated using the eight learning 
outcomes above. (See appendix A for Internship Evaluation Grid) 


At the advanced level, the artifacts available on the online portfolios of graduated 
students were used to assess the learning outcomes. Links to graduated students’ 
electronic portfolios were entered into a spreadsheet. Ten percent of the portfolios were 
selected using the online randomizing tool, Randomizer. Thus, of the 34 student 
portfolios, 5 were assessed for a total of 14.7%. The external reviewer received the 
assessment rubric and two to three portfolios to assess. 


The following scale was used to assess the learning outcomes: 
The assessment values are the same for all learning outcomes: 
1 = Noor Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 

3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 





D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. (Please see attached Grid 
that explains the sequence of courses in the B.A. and B.S. in Multimedia Journalism.) 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understand of this learning outcome was 2.75. Of these 2 
students (40%) occasionally, 1 (20%) demonstrated this learning outcome well but 
needed more work and 2 (40%) demonstrated it well. The intermediate assessment was 
not utilized last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 4.25, which was slightly higher than the previous year (4.1). This 
indicated that portfolios provided good representation of this learning outcome. 


The overall grade was 84%. 








D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. 


Opportunities for students to learn the student learning outcome: 

All students in Multimedia Journalism are required to take a course in Data Journalism. 
All students are required to use data in their capstone project. They also need to have 
research skills to collect data for all their writing courses. 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 
No internship assessment of this learning outcome was available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 4.25, which was 
slightly higher than last year (4.15) and indicated that portfolios provided a good 
representation of this learning outcome. 


The overall grade for this learning outcome was 84%. 





D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to write clearly and without errors, craft language for interesting 
and effective communication, write across platforms effectively, and communicate to a 
wide and diverse audience. 


Opportunities for students to learn the student learning outcomes: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program, in this case 
Reporting and Electronic Reporting. In addition, students in the Multimedia News track 
have additional courses including Editing in Multimedia, Public Affairs Reporting and 
Data Journalism. (Please see attached Grid that explains the sequence of courses in the 
B.A. and B.S. in Multimedia Journalism.) 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understanding of this learning outcome was 4.42 and by 
far the biggest majority of students showed evidence that they performed well. One 
student (20%) demonstrated some skills but needed more work, 1 (20%) demonstrated 
this learning outcome well and 3 (60%) expertly demonstrated these skills. The 
intermediate assessment was not utilized last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 3.5 (which is down 
slightly from the previous year 3.9), which indicated that portfolios represented this 
learning outcome well and improved over the past year. 


The overall grade for this learning outcome was 76%. 





E. Summary of Assessment Results 





The portfolio process in the school has come a long way. The assessment results for the 
Multimedia Journalism degree program suggest that further attention and effort should be 
placed on developing writing, editing and production techniques. 


In indicated in past assessments, using professionals to evaluate these portfolios is somewhat 
cumbersome in that they do not understand this level of assessment. They continuously ask 
questions about the students’ work and comment that they do not wish to penalize them 
unnecessarily. This year the professional were better counseled on what the assessment and 
portfolios actually measure. Taking time to train the professionals on the purpose of the 
assessment led to a better participation and cooperation. 


Finally, new assessment tools need to be created/utilized to assess the other 5 learning 
outcomes. 


The review process this year suggested the school should undertake three steps before the next 
assessment round: 


1. Develop a pre-test/post-test that can be administered in MC 2003 (pre-test) and the end 
of the capstone course (post-test) in order to assess learning outcomes that are not 
easily demonstrated in the portfolios. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. 
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Appendix A: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


5. An understanding of the relevant theories and concepts of 
mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 


Not applicable 


Not demonstrated 


Demonstrated only slightly 


Demonstrated occasionally 


Demonstrated well 


Demonstrated but needs work 


Expertly demonstrated 











Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 


INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation. Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface, 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 








Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 








gathering. 
The ability to use 


multiple methods 
and sources to 
research 
information. 





The ability to 
effectively 
communicate how 
information was 
gathered. 





10 





Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction, 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 











The ability to 
effectively 
communicate toa 
wide and diverse 
audience. 
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2014 - 2015 
Annual Assessment Report 


Bachelor of Arts and Bachelor of Science 
Strategic Communication 





Annual Assessment Report 






LCT be, School of Media and Strategic Communications 
/ College of Arts & Sciences 
UNIVERSITY g BA and BS in Sports Media 
= 
j 2014-2015 


Date: September 15, 2015 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 
Assessment Coordinator’s email: bobbikay.lewis@okstate.edu 
Number of students enrolled in the program 2014-15: 171 
Number of students graduated in 2014-15: 39 








B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 
states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 





Oklahoma State University School of Media and Strategic Communications will do this 


by promoting: 
e Critical thinking 
e Creativity 


e Global awareness 

e Appreciation for the liberal arts 
e Adaptability 

e Problem solving skills 

e Diversity 

e Leadership 

e Community involvement 





C. University Assessment Funds 
Were university assessment funds used by the department/program for 
assessment activities? [_] Yes ANo 
If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 





D. Assessed Student Learning Outcomes 





Like the 2013-14 assessment, this assessment cycle only three learning outcomes were 
assessed because the students’ capstone online portfolios were used for assessment. 
However, after the 2012-13 assessment it was decided that portfolios lend themselves best to 
assess these three learning outcomes and that other criteria should be used to assess the 
other, more theoretical learning outcomes. A new plan to assess the other learning outcomes 
was to be developed for this year. Due to a change in leadership, the assessment plan was not 
restructured to address the other outcomes. A new assessment plan will be developed during 
the 2015-16 academic year, and the 2015-16 report will reflect the new plan. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 


and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Assessment methods: 


Two assessment methods were used to evaluate the three learning outcomes: one at the 
intermediate level and one at the advanced level. 


Internship: At the intermediate level the assessment reports of 5 students’ internship advisers 
were collected and data analyzed. Student internships are evaluated using the eight learning 
outcomes above. (See appendix A for Internship Evaluation Grid) 


Capstone project: Students complete an online portfolio with artifacts created throughout the 
program and submit the portfolio to the instructor as part of their capstone class. At the 
advanced level, the artifacts available on the online portfolios of graduated students were used 
to assess the learning outcomes. The links to graduated students’ electronic portfolios were 
entered into a spreadsheet. Ten percent of the Spring 2015 portfolios were selected using the 
online randomizing tool, Randomizer. Thus, of the 64 student portfolios, 10 were selected for 
assessment for a total of 12.5%. One external reviewer did not return the assessment of two 
portfolios, and only eight portfolios are considered in the assessment report. External reviewers 
received the assessment rubric and the URL to the online portfolios. 


The following scale was used to assess the learning outcomes: 
The assessment values are the same for all learning outcomes: 
1 = No or Poor representation of learning outcome; 
2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 
4 = Good representation of learning outcome; 
5 = Outstanding representation of learning outcome. 


2 











D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understand of this learning outcome was 2.95. Of these 2 
students (50%) occasionally, 2 (25%) demonstrated this learning outcome well but 
needed more work and 1 (25%) demonstrated it well. The intermediate assessment was 
not utilized last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 3.5, which is higher than the previous year (2.69). This indicated 
that portfolios provided an average representation of this learning outcome with room for 
improvement. 


The overall grade was 64% compared to 53.8% the previous year. 





D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. 


Opportunities for students to learn the student learning outcome: 

All students in Sports Media are incorporate information gathering and sports data 
analysis in their writing courses. All students are required to use data in their capstone 
project. 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understanding of this learning outcome was 3.75. Two 
students (40%) demonstrated this well but needed more work, and 3 students (60%) 
demonstrated this learning outcome well. The intermediate assessment was not utilized 
last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 3.15, which was 
higher than last year (2.25) and indicated that portfolios provided an improved 
representation of this learning outcome with room for continued improvement. 


The overall grade for this learning outcome was 62% compared to 45% the previous 
year. 








D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to write clearly and without errors, craft language for interesting 
and effective communication, write across platforms effectively, and communicate to a 
wide and diverse audience. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program. Sports Strat 
Comm majors include: Persuasive Writing and Sports PR. Sports Journalism majors 
include: Reporting, Electronic Sports Reporting, Editing, Data Journalism and Sports 
Writigng. Sports production majors include: Reporting, Electronic Sports Reporting, and 
editing in production courses. In addition, Sports Media students are expected to show 
these skills in their capstone course. 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understanding of this learning outcome was 2.95. Three 
(60%) of interns occasionally demonstrated these skills and 2 (40%) demonstrated this 
well. The intermediate assessment was not utilized last year, so comparison is not 
available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 3.5 (previously 2.4), 
which indicated that portfolios modestly represented this learning outcome and improved 
from the previous year. 


The overall grade for this learning outcome was 70% compared to 48% the previous 
year. 








E. Summary of Assessment Results 





The portfolio process in the school has come a long way. This is particularly true for students in 
the sports media degree. The assessment results indicate that the students’ work is improving; 
each of the three outcomes assessed improved from the previous year. However, the results 
indicate there is room for improvement, also. 


As indicated in past assessments, using professionals to evaluate these portfolios is somewhat 
cumbersome in that they do not understand this level of assessment. They continuously ask 
questions about the students’ work and comment that they do not wish to penalize them 
unnecessarily. This year the professional were better counseled on what the assessment and 
portfolios actually measure. Taking time to train the professionals on the purpose of the 
assessment led to a better participation and cooperation. 


Finally, new assessment tools need to be created/utilized to assess the other 5 learning 
outcomes. 


The review process this year suggested the school should undertake three steps before the next 
assessment round: 


1. Develop a pre-test/post-test that can be administered in MC 2003 (pre-test) and the end 
of the capstone course (post-test) in order to assess learning outcomes that are not 
easily demonstrated in the portfolios. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. 
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Appendix A: INTERNSHIP EVALUATION TABLE 








To what extent does the intern demonstrate the following 2 i >| 2B a a 
icti 3 3 =a | a S = 
characteristics? 8 fè wh | S 3 be 
= an — 

ra £ a | A ks] g 
T S >| 5 3 B 
5 E ES E a 
we, hz ke] ko) 5 te] 
6 D D = fz] 
Z 8 8 3 oO 
g| g B A 

[=] ej B 

© © ” 

a | £ £ 

o oO £ 

QA [m] 5 

A 

2 3 4 





Expertly demonstrated 








1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 












2. An understanding of the relevance of human diversity in 
mass communications. 













3. An understanding of the history and social role of mass 
communications., 









4. Critical, creative and individual thinking. 












5. An understanding of the relevant theories and concepts of 
mass communications. 










6. An understanding of the methods and techniques of 
research and information gathering. 










7. Appropriate writing, editing and production techniques in 
mass communications, 







8. An understanding of relevant planning and management 
methods in mass communications. 












Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 


INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation. Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
=Somewhat poor representation of learning outcome; 

3=Average representation of learning outcome; 

4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 








Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
athering. 
The ability to use 
multiple methods 
and sources to 
research 
information. 


The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 





The ability to 
effectively 
communicate to a 
wide and diverse 
audience. 
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2014 - 2015 
Annual Assessment Report 


Bachelor of Arts and Bachelor of Science 
Sports Media 








— Annual Assessment Report 


OKLAHOMA « school of Media and Strategic Communications 
College of Arts & Sciences 
EAA E BA and BS in Strategic Communication 
z / 2014-2015 


® 


Date: September 15, 2015 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 
Assessment Coordinator’s email: bobbikay.lewis @okstate.edu 
Number of students enrolled in the program 2014-15: 328 
Number of students graduated in 2014-15: 96 





B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 
states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 





Oklahoma State University School of Media and Strategic Communications will do this 


by promoting: 
e Critical thinking 
e Creativity 


e Global awareness 

* Appreciation for the liberal arts 
* Adaptability 

e Problem solving skills 

e Diversity 

e Leadership 

e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 
assessment activities? [_] Yes [XINo 
If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 





D. Assessed Student Learning Outcomes 





Like the 2013-14 assessment, this assessment cycle only three learning outcomes were 
assessed because the students’ capstone online portfolios were used for assessment. 


l 





However, after the 2012-13 assessment it was decided that portfolios lend themselves 
best to assess these three learning outcomes and that other criteria should be used to 
assess the other, more theoretical learning outcomes. A new plan to assess the other 
learning outcomes was to be developed for this year. Due to a change in leadership, the 
assessment plan was not restructured to address the other outcomes. A new 
assessment plan will be developed during the 2015-16 academic year, and the 2015-16 
report will reflect the new plan. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they 
relate to individual disciplines in mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of 
research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Assessment methods: 


Two assessment methods were used to evaluate the three learning outcomes: one at 
the intermediate level and one at the advanced level. 


Internship: At the intermediate level the assessment reports of 5 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using the 
eight learning outcomes above. (See appendix A for Internship Evaluation Grid) 


Capstone project: Students complete an online portfolio with artifacts created 
throughout the program and submit the portfolio to the instructor as part of their capstone 
class. At the advanced level, the artifacts available on the online portfolios of graduated 
students were used to assess the learning outcomes. The links to graduated students’ 
electronic portfolios were entered into a spreadsheet. Ten percent of the Spring 2015 
portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 64 
student portfolios, 10 were selected for assessment for a total of 12.5%. One external 
reviewer did not return the assessment of two portfolios, and only eight portfolios are 
considered in the assessment report. External reviewers received the assessment rubric 
and the URL to the online portfolios. 


The following scale was used to assess the learning outcomes: 
The assessment values are the same for all learning outcomes: 
1 = No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 

3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 





D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are required to come up with solutions to difficult communication 
problems in all courses where they have to propose and analyze research, 
communication campaigns, message or graphic design solutions, media plans and/or 
address crisis situations. (Please see attached Grid that explains the sequence of 
courses in the B.A. and B.S. in Strategic Communication.) 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understand of this learning outcome was 3.75. Of these 3 
students (30%) demonstrated this learning outcome well but needed more work, 6 (60%) 
demonstrated it well, and 1 (10%) expertly demonstrated critical thinking. The 
intermediate assessment was not utilized last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 4.1, which was slight higher than the previous year (4.0). This 
indicated that portfolios provided good representation of this learning outcome. 


The overall grade was 83.5%. 





D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. 


Opportunities for students to learn the student learning outcome: 

All students in Strategic Communication are required to take a course in Research 
Methods. All students are required to use research and data in their capstone project. 
They also need to have research skills to collect data for all their writing courses. 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understanding of this learning outcome was 4.0. One 
(10%) student demonstrated this well but needed more work, while 9 students (90%) 
demonstrated this learning outcome well. The Intermediate assessment was not utilized 
last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 4.12, which was 
slightly higher than last year (4.06) and indicated that portfolios provided a good 
representation of this learning outcome. 


The overall grade for this learning outcome was 83%. 





D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to write clearly and without errors, craft language for interesting 
and effective communication, write across platforms effectively, and communicate to a 
wide and diverse audience. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program, in this case 
Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. 


Assessment method used to gather evidence of student achievement: 
Please see explanation on p. 2 of this document for an explanation of assessment 
methods used. 


Summary of assessment evidence / results from the assessment method: 
All evaluations used a scale of 1-5, using the following criteria: 
1 = Inadequate Understanding - 5 = Solid Understanding. 


Intermediate assessment: 

The mean score for students’ understanding of this learning outcome was 4.3 and no 
students exhibited an inadequate ability on this learning outcome. Seven students (70%) 
demonstrated this well and 3 (30%) expertly demonstrated this. The Intermediate 
assessment was not utilized last year, so comparison is not available. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 

editing and production techniques in mass communication was 3.65, which was slightly 
higher than last year (3.53). This indicated portfolios represented this learning outcome 
well, although it needs refocused attention. 


The overall grade for this learning outcome was 80.5% 





E. Summary of Assessment Results 





The portfolio process in the school has come a long way. The assessment results for the 
Strategic Communications degree program indicate that the students’ work is improving; each of 
the three outcomes assessed improved slightly from the previous year. However, the results 
indicate there is room for improvement. The internship results suggest that particular attention 
should be paid to improving students’ ability to analyze complex situations accurately, to craft 
innovative solutions to difficult problems, to look beyond the obvious, and the ability to 
effectively communicate complex ideas. 


In indicated in past assessments, using professionals to evaluate these portfolios is somewhat 
cumbersome in that they do not understand this level of assessment. They continuously ask 
questions about the students’ work and comment that they do not wish to penalize them 
unnecessarily. This year the professional were better counseled on what the assessment and 
portfolios actually measure. Taking time to train the professionals on the purpose of the 
assessment led to a better participation and cooperation. It is critical that external reviewers are 
trained annually to understand what the assessment process is and how the school uses the 
data they provide. 


Finally, new assessment tools need to be created/utilized to assess the other 5 learning 
outcomes. 


The review process this year suggested the school should undertake three steps before the next 
assessment round: 


1. Develop a pre-test/post-test that can be administered in MC 2003 (pre-test) and the end 
of the capstone course (post-test) in order to assess learning outcomes that are not 
easily demonstrated in the portfolios. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. 
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Appendix A: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


Not demonstrated 


2 
3 
ò 
2 
ay 
is] 
ns 
io} 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 


Demonstrated only slightly 


Demonstrated occasionally 


Demonstrated but needs work 


Demonstrated well 


Expertly demonstrated 








Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 


INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation. Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 














Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 








The ability to 
effectively 
communicate how 
information was 
gathered, 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 





Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 








Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 











The ability to 
effectively 
communicate toa 
wide and diverse 
audience, 
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Annual Assessment Report 


oxtanoma! dl » School of Media and Strategic Communications 
College of Arts & Sciences 
AA BA in Multimedia Journalism 
ao 
i 2015-2016 


Date: September 15, 2016 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 


Assessment Coordinator’s email: bobbikay.lewis @okstate.edu 
Number of students enrolled in the program 2015-16: 39 
Number of students graduated in 2015-16: 109 


B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 


states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 


Oklahoma State University School of Media and Strategic Communications will do this 
by promoting: 

Critical thinking 

Creativity 

Global awareness 
Appreciation for the liberal arts 
Adaptability 

Problem solving skills 
Diversity 

Leadership 

Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 


assessment activities? [_] Yes [XINo 

If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 





D. Assessed Student Learning Outcomes 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues 
and ethical principles involved in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass 


communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass 
communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of 


mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 


and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Assessment methods: 
Three assessment methods were used to evaluate the three learning outcomes: (1) Capstone 
Projects/Portfolios, (2) Internship Evaluation and (3) Senior Exit Interviews. 


Assessment Method 1 - Capstone Project/Portfolios: Students complete an online portfolio 
with artifacts created throughout the program and submit the portfolio to the instructor as part of 
their capstone class. At the advanced level, the artifacts available on the online portfolios of 
graduated students were used to assess the learning outcomes. The links to graduated 
students’ electronic portfolios were entered into a spreadsheet. Twenty percent of the Spring 
2016 portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 39 
student portfolios, 5 were selected for assessment for a total of 12%. Three external reviewers 
received the assessment rubric via Survey Monkey and the URLs to the sample of online 
portfolios. 





The following scale was used to assess learning outcomes 4, 6 and 7: 
(The assessment values are the same for all learning outcomes) 
1 = No or Poor representation of learning outcome; 
2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 
4 = Good representation of learning outcome; 
5 = Outstanding representation of learning outcome. 


Assessment Method 2 - Internship Evaluation: Assessment reports of 5 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using the same 
three learning outcomes listed above, which were also assessed by the Capstone 
Projects/Portfolios. (See appendix A for Internship Evaluation Grid) 


D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. In the internship assessment internship supervisors only 
provide an overall assessment of the learning outcome. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 
The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 3.85, which is slightly lower than the last year (4.25). 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6 ona 
7-point scale. Of these 5 students, 3 students (60%) demonstrated this learning outcome 
occasionally, 1 (20%) demonstrated this learning outcome well but needed more work 
and 1 (20%) demonstrated it well. This demonstrates improvement from last year. 


The overall grade was 77% compared to 74% the previous year. This indicates room for 
improvement. 








D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. In the internship 
assessment, internship supervisors only provide an overall assessment of the learning 
outcome. 


Opportunities for students to learn the student learning outcome: 

All students in Multimedia Journalism incorporate information gathering and data 
analysis in the Data Journalism course as well as their writing courses. All students are 
required to use data in their capstone project. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 4.1, which is slightly 
lower than last year (4.25). 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6 based on 
a 7-point scale. Two students (40%) demonstrated this well, 2 students (40%) 
demonstrated this learning outcome occasionally and 1 student (20%) demonstrated this 
learning outcome only slightly. No internship assessment of this learning outcome was 
available last year. 


The overall grade for this learning outcome was 79% compared to 84% last year. This 
grade demonstrates continued room for improvement. 








D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 
In the indirect measure Internship Evaluation, internship supervisors only provide an 
overall assessment of the learning outcome. 


In the Capstone Project/Portfolio assessment, this learning outcome assessed if the 
students’ work showed evidence of the ability to write clearly and without errors, craft 
language for interesting and effective communication, write across platforms effectively, 
and communicate to a wide and diverse audience. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program. All Multimedia 
Journalism majors are required to complete the following courses: Fundamentals of 
Audio Video, Reporting, and Electronic Reporting. Multimedia News majors include: 
Editing in Multimedia, Public Affairs Reporting, and Data Journalism. Multimedia 
Production majors include: Field Production, and Advanced Production Practices. In 
addition, Multimedia Journalism students are expected to show these skills in their 
capstone course. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 3.8 (last year 3.5, 
previously 3.9), which indicates that this learning outcome was represented in the 
portfolios with little demonstration of improvement over 3 years. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 5.2 on 7-point 
scale. This is a moderate improvement from last year (4.42). Two (40%) of interns 
occasionally demonstrated these skills and 3 (60%) demonstrated this well. 


The overall grade for this learning outcome was 81% compared to 76% last year. 








Assessment Method 3 - Senior Exit Interviews: The associate director of undergraduate 
studies conducted one-on-one interviews with 5 outgoing Sports Media seniors. Students were 
randomly selected and asked to participate in the interviews. Embedded in the discussion were 
direct questions concerning the following learning outcomes: 


(D4) Learning outcome 1. Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Opportunities for students to learn the student learning outcome: 
All students are required to take the core courses in Mass Communication Law and 
Media Ethics. 


Summary of assessment evidence / results from the assessment method: 

Out of the five students interviewed, all five students communicated that they learned a 
great deal about constitutional freedoms and legal issues. They felt good about their 
understanding of the First Amendment. However, three of the students communicated 
that ethical principles were not heavily emphasized and felt hesitant in their mastery of 
that content. 


(D5) Learning outcome 2. Students will demonstrate an understanding of the relevance of 
human diversity in mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core course Media in a Diverse Society, which 
places considerable emphasis on the relevance of diversity in mass communications 
and the media. Also, the relevance of diversity is also covered in all of the Multimedia 
Journalism curriculum, including but not limited to Data Journalism, Reporting and Media 
Management. 


Summary of assessment evidence / results from the assessment method: 

All of the students expressed an understanding of the relevance of diversity. They 
indicated that it was covered in most all of their major courses. One of the students 
mentioned that the topic should have been addressed more. 


(D6) Learning outcome 3. Students will demonstrate respect for the history and social 
role of mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Mass Communication Law and Media Ethics. All of the courses include curricula on the 
history and social role of mass communications. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of history and 
social role of mass communications. They indicated that it was covered in the Media in a 
Divers Society course. Two of the students mentioned that it was discussed in many of 
their major courses. 








(D7) Learning outcome 5. Students will demonstrate an understanding of the relevant 
theories and concepts of mass communication. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Electronic Communications, Mass Communication Law and Media Ethics. All of the 
courses include material on the relevant theories and concepts of mass 
communications. In addition, Multimedia Journalism students are exposed to and asked 
to apply to the relevant theories and concepts of Journalism through most of the courses 
in MMJ, including the capstone course. 


Summary of assessment evidence / results from the assessment method: 

The students interviewed mentioned very little about media theories or theoretical 
concepts. When prompted about it, two of the students said they remember theories 
such as agenda setting and framing being discussed. 


(D8) Learning outcome 8. Students will demonstrate an understanding of relevant 
planning and management methods in mass communication. 


Opportunities for students to learn the student learning outcome: 
All Multimedia Journalism students are required to take a Media Management course. 


Summary of assessment evidence / results from the assessment method: 

Most of the students interviewed indicated that the importance of planning and media 
management was not emphasized. When probed about it specifically, three of the 
students indicated that they learned the importance of planning in writing and electronic 
storytelling. Only one of the students maintained that he gained an understanding of 
media management. 





E. Summary of Assessment Results 


The portfolio process in the school is slowly being improved upon each year. The school now 
has a more systematic and thorough plan to assess student learning. The senior 
capstone/portfolio assessment was streamlined this year utilizing an electronic survey, making 
the process much easier for the professionals to complete. This year, senior exit interviews 
were added which improved the assessment process and allowed for better evaluation of the 
remaining 5 learning outcomes that were not assessed in the past 2 assessment cycles. The 
assessment plan calls for two additional methods which are being developed and administered 
for the 2016-17 academic year. 


The assessment results indicate that the students’ work is improving; two of the three outcomes 
assessed last year and this year improved from the previous year, while one showed slight 
decline. The results indicate there is still room for improvement. The five learning outcomes that 
were newly assessed this year with the exit interviews cannot be compared to previous data, 
but the evaluation indicates the program is meeting most of the learning outcomes with room for 
improvement. 


The following steps were recommended last year, and there is now a clear plan to implement 
these steps in this coming assessment round: 


1. Administer the pre-test/post-test in MC 2003 (pre-test) and the end of the capstone 
course (post-test) in order to assess learning outcomes that are not easily demonstrated 
in the portfolios. The pre-test will be administered the first day of class in MC 2003 in 
Spring 2017. The post-test will be administered during the last two weeks of classes in 
the capstone course. The pre-test/post-test will be used to measure learning from the 
core curricula, which students in all 6 of the degree programs in SMSC are required to 
take. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. This recommendation will be discussed with the faculty in the October 2016 
faculty meeting. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. The assessment plan/report will be brought 
to the curriculum committee to review and discuss possible curriculum changes. 


In addition to the steps mentioned above, an Alumni Survey should be developed and utilized 
as a method to assess the program and the preparedness for the media industry among SMSC 
graduates. 
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APPENDIX A: 


SCHOOL OF MEDIA & STRATEGIC COMMUNICATION 


REQUIRED COURSES (2015-16) 





MC 1143 - Media in a Diverse Society (GEN ED) (S,D) 
Comp. Il w/C or better) 


MC 2003 - Style & Structure (2.5 or better, 
MC 2023 - Electronic Communication (2.5 or better, 


STRATEGIC 
COMMUNICATION 
REQUIRED COURSES 


SC 2183 Intro to SC 
(2.5 or better) 
SC 3353 
Persuasive Writing for SC 


Comp. 





MMJ 3153 
Fundamentals of Audio Video 
MMJ 3263 
Reporting 


SPORTS MEDIA 
REQUIRED COURSES 


Sports in the Media 


Contemporary Sports Media 





SPM 2843 


SPM 3843 








SC 3753 





MMJ 3553 | Sports 
Electronic Reporting |__ Strat Comm | 
MMJ 4863 $C 2183 


Media Management | Intro SC 


SC Mgmt & Strategies 


MMJ 3153 
Fund Audio-Video 


MMI 3263 
Reporting 








Multimedia Multimedia 
News Production 
MMJ 3313 
Editing in 
Multimedia 
MMJ 4313 
Public Affairs 
Reporting 
MMI 4393 
| Data Journalism 


SC 3953 
Research Methods for SC 





SC 3753 
Graphic 
Design SC 
SC 3953 
Research 
Methods SC 
SPM 3783 
Sports PR 


MMJ 3913 
Field Production 


SC 4013 
| Advertising Media & Markets 











MMJ 4953 
Adv. Production 
Practices 


Advanced Writing Class 
Advertising: Public Relations: 
SC 4493 


Advanced 
PR Writing 


SC 3603 
| Copywriting & 
| Creative Strategy 


Departmental 
Elective - U 


SPM 3863 
Electronic Sports Rep. 








Sports 
Production 


Sports 
Journalism 


MMI 3913 
Field Prod. 


MMI 3313 
Editing 


SPM 4813 
Sp. Media Prod. | 


MMJ 4393 
Data Journalism 








; Departmental 
Elective -U 
(Internship) 


Departmental Elective -U 


Departmental Elective -U 
(Internship) 


(Internship) 


| Sports Writing 


Departmental | 
Elective -U | 
(Internship) 


SPM 3853 








| Departmental 
= Elective -U 
(Internship) 
| Departmental 
Elective -U 
(Internship) 


Departmental Elective -U 
(Internship) 


Departmental Elective -U 
(Internship) 





Departmental Elective U/L 


Departmental Elective -U 
(Internship) 


Departmental Elective U/L 





| Departmental | 


D Elective U j 
epartmental Elective U/L Elective U/L 


SPM 4933 
Adv Sports PR 


SC 4843 (or 4980) 


MMJ 4973 
SC Campaigns 


MMJ Capstone 






Departmental Elective U/L 


SPM 4883 
Sports in the Newsroom 





















| MKTG 3213 | POLS* | TLA/BUS/GE || MKTG 3213 | TLA/BUS/GE | 
| MKTG | POLS* | TLA/BUS/GE MKTG TLA/BUS/GE 
| TLA/BUS/GE I| TLA/BUS/GE | TLA/BUS/GE TLA/BUS/GE TLA/BUS/GE 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Values 1-5 assess the QUALITY of 
learning outcome. Please assign the value of 1 if you cannot find any evidence that 
the learning outcome is represented. 


The assessment values are the same for all learning outcomes: 
1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 

4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 








Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 











The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 














Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 














The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively, 














The ability to 
effectively 
communicate to a 
wide and diverse 
audience. 
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Appendix C: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


Not demonstrated 
Demonstrated only slightly 
Demonstrated occasionally 

Demonstrated but needs work 
Demonstrated well 
Expertly demonstrated 


1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 

















6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 





2 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation, Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 
5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
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Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 














Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 


The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 














The ability to 
effectively 
communicate to a 
wide and diverse 
audience, 
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2015 - 2016 
Annual Assessment Report 


Bachelor of Science 
Multimedia Journalism 





Annual Assessment Report 





oxtanoma Í School of Media and Strategic Communications 
7 College of Arts & Sciences 
UNIVERSITY 9 al BS in Multimedia Journalism 
2015-2016 


Date: September 15, 2016 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 


Assessment Coordinator’s email: bobbikay.lewis@okstate.edu 
Number of students enrolled in the program 2015-16: 39 
Number of students graduated in 2015-16: 109 


B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 


states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 


Oklahoma State University School of Media and Strategic Communications will do this 
by promoting: 
e Critical thinking 
Creativity 
e Global awareness 
e Appreciation for the liberal arts 
e 
e 


Adaptability 
Problem solving skills 
e Diversity 
e Leadership 
e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 


assessment activities? [_] Yes [XINo 

If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 








D. Assessed Student Learning Outcomes 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues 
and ethical principles involved in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass 


communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass 
communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of 


mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 


and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management 


methods in mass communication. 


Assessment methods: 
Three assessment methods were used to evaluate the three learning outcomes: (1) Capstone 
Projects/Portfolios, (2) Internship Evaluation and (3) Senior Exit Interviews. 


Assessment Method 1 - Capstone Project/Portfolios: Students complete an online portfolio 
with artifacts created throughout the program and submit the portfolio to the instructor as part of 
their capstone class. At the advanced level, the artifacts available on the online portfolios of 
graduated students were used to assess the learning outcomes. The links to graduated 
students’ electronic portfolios were entered into a spreadsheet. Twenty percent of the Spring 
2016 portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 39 
student portfolios, 5 were selected for assessment for a total of 12%. Three external reviewers 
received the assessment rubric via Survey Monkey and the URLs to the sample of online 
portfolios. 








The following scale was used to assess learning outcomes 4, 6 and 7: 
(The assessment values are the same for all learning outcomes) 
1 = No or Poor representation of learning outcome; 
2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 
4 = Good representation of learning outcome; 
5 = Outstanding representation of learning outcome. 


Assessment Method 2 - Internship Evaluation: Assessment reports of 5 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using the same 
three learning outcomes listed above, which were also assessed by the Capstone 
Projects/Portfolios. (See appendix A for Internship Evaluation Grid) 


D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. In the internship assessment internship supervisors only 
provide an overall assessment of the learning outcome. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 
The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 3.85, which is slightly lower than the last year (4.25). 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6 ona 
7-point scale. Of these 5 students, 3 students (60%) demonstrated this learning outcome 
occasionally, 1 (20%) demonstrated this learning outcome well but needed more work 
and 1 (20%) demonstrated it well. This demonstrates improvement from last year. 


The overall grade was 77% compared to 74% the previous year. This indicates room for 
improvement. 








D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. In the internship 
assessment, internship supervisors only provide an overall assessment of the learning 
outcome. 


Opportunities for students to learn the student learning outcome: 

All students in Multimedia Journalism incorporate information gathering and data 
analysis in the Data Journalism course as well as their writing courses. All students are 
required to use data in their capstone project. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 4.1, which is slightly 
lower than last year (4.25). 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6 based on 
a 7-point scale. Two students (40%) demonstrated this well, 2 students (40%) 
demonstrated this learning outcome occasionally and 1 student (20%) demonstrated this 
learning outcome only slightly. No internship assessment of this learning outcome was 
available last year. 


The overall grade for this learning outcome was 79% compared to 84% last year, This 
grade demonstrates continued room for improvement. 








D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 
In the indirect measure Internship Evaluation, internship supervisors only provide an 
overall assessment of the learning outcome. 


In the Capstone Project/Portfolio assessment, this learning outcome assessed if the 
students’ work showed evidence of the ability to write clearly and without errors, craft 
language for interesting and effective communication, write across platforms effectively, 
and communicate to a wide and diverse audience. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program. All Multimedia 
Journalism majors are required to complete the following courses: Fundamentals of 
Audio Video, Reporting, and Electronic Reporting. Multimedia News majors include: 
Editing in Multimedia, Public Affairs Reporting, and Data Journalism. Multimedia 
Production majors include: Field Production, and Advanced Production Practices. In 
addition, Multimedia Journalism students are expected to show these skills in their 
capstone course. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 3.8 (last year 3.5, 
previously 3.9), which indicates that this learning outcome was represented in the 
portfolios with little demonstration of improvement over 3 years. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 5.2 on 7-point 
scale. This is a moderate improvement from last year (4.42). Two (40%) of interns 
occasionally demonstrated these skills and 3 (60%) demonstrated this well. 


The overall grade for this learning outcome was 81% compared to 76% last year. 





Assessment Method 3 - Senior Exit Interviews: The associate director of undergraduate 
studies conducted one-on-one interviews with 5 outgoing Sports Media seniors. Students were 
randomly selected and asked to participate in the interviews. Embedded in the discussion were 
direct questions concerning the following learning outcomes: 


(D4) Learning outcome 1. Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Opportunities for students to learn the student learning outcome: 
All students are required to take the core courses in Mass Communication Law and 
Media Ethics. 


Summary of assessment evidence / results from the assessment method: 

Out of the five students interviewed, all five students communicated that they learned a 
great deal about constitutional freedoms and legal issues. They felt good about their 
understanding of the First Amendment. However, three of the students communicated 
that ethical principles were not heavily emphasized and felt hesitant in their mastery of 
that content. 


(D5) Learning outcome 2. Students will demonstrate an understanding of the relevance of 
human diversity in mass communications, 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core course Media in a Diverse Society, which 
places considerable emphasis on the relevance of diversity in mass communications 
and the media. Also, the relevance of diversity is also covered in all of the Multimedia 
Journalism curriculum, including but not limited to Data Journalism, Reporting and Media 
Management. 


Summary of assessment evidence / results from the assessment method: 

All of the students expressed an understanding of the relevance of diversity. They 
indicated that it was covered in most all of their major courses. One of the students 
mentioned that the topic should have been addressed more. 


(D6) Learning outcome 3. Students will demonstrate respect for the history and social 
role of mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Mass Communication Law and Media Ethics. All of the courses include curricula on the 
history and social role of mass communications. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of history and 
social role of mass communications. They indicated that it was covered in the Media in a 
Divers Society course. Two of the students mentioned that it was discussed in many of 
their major courses. 





(D7) Learning outcome 5, Students will demonstrate an understanding of the relevant 
theories and concepts of mass communication. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Electronic Communications, Mass Communication Law and Media Ethics. All of the 
courses include material on the relevant theories and concepts of mass 
communications. In addition, Multimedia Journalism students are exposed to and asked 
to apply to the relevant theories and concepts of Journalism through most of the courses 
in MMJ, including the capstone course. 


Summary of assessment evidence / results from the assessment method: 

The students interviewed mentioned very little about media theories or theoretical 
concepts. When prompted about it, two of the students said they remember theories 
such as agenda setting and framing being discussed. 


(D8) Learning outcome 8. Students will demonstrate an understanding of relevant 
planning and management methods in mass communication. 


Opportunities for students to learn the student learning outcome: 
All Multimedia Journalism students are required to take a Media Management course. 


Summary of assessment evidence / results from the assessment method: 

Most of the students interviewed indicated that the importance of planning and media 
management was not emphasized. When probed about it specifically, three of the 
students indicated that they learned the importance of planning in writing and electronic 
storytelling. Only one of the students maintained that he gained an understanding of 
media management. 





E. Summary of Assessment Results 


The portfolio process in the school is slowly being improved upon each year. The school now 
has a more systematic and thorough plan to assess student learning. The senior 
capstone/portfolio assessment was streamlined this year utilizing an electronic survey, making 
the process much easier for the professionals to complete. This year, senior exit interviews 
were added which improved the assessment process and allowed for better evaluation of the 
remaining 5 learning outcomes that were not assessed in the past 2 assessment cycles. The 
assessment plan calls for two additional methods which are being developed and administered 
for the 2016-17 academic year. 


The assessment results indicate that the students’ work is improving; two of the three outcomes 
assessed last year and this year improved from the previous year, while one showed slight 
decline. The results indicate there is still room for improvement. The five learning outcomes that 
were newly assessed this year with the exit interviews cannot be compared to previous data, 
but the evaluation indicates the program is meeting most of the learning outcomes with room for 


improvement. 


The following steps were recommended last year, and there is now a clear plan to implement 
these steps in this coming assessment round: 


1. Administer the pre-test/post-test in MC 2003 (pre-test) and the end of the capstone 
course (post-test) in order to assess learning outcomes that are not easily demonstrated 
in the portfolios. The pre-test will be administered the first day of class in MC 2003 in 
Spring 2017. The post-test will be administered during the last two weeks of classes in 
the capstone course. The pre-test/post-test will be used to measure learning from the 
core curricula, which students in all 6 of the degree programs in SMSC are required to 
take. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio, This recommendation will be discussed with the faculty in the October 2016 
faculty meeting. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. The assessment plan/report will be brought 
to the curriculum committee to review and discuss possible curriculum changes. 


In addition to the steps mentioned above, an Alumni Survey should be developed and utilized 
as a method to assess the program and the preparedness for the media industry among SMSC 
graduates. 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Values 1-5 assess the QUALITY of 
learning outcome. Please assign the value of 1 if you cannot find any evidence that 
the learning outcome is represented. 


The assessment values are the same for all learning outcomes: 
1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 

4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 








Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately, 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 














Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
pletel - 
Evidence of 
initiative and 
creativity in 
information 
gathering. 
The ability to use 
multiple methods 
and sources to 
research 
information. 














The ability to 
effectively 
commutnicate how 
information was 
gathered. 








Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 

















The ability to 
effectively 
communicate toa 
wide and diverse 
audience. 
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Appendix C: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


Not demonstrated 
Demonstrated only slightly 
Demonstrated occasionally 

Demonstrated but needs work 
Demonstrated well 
Expertly demonstrated 


1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 














6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 














8. An understanding of relevant planning and management 
methods in mass communications. 





2 
Q 
Ss 
8 
2 
Q 
an 
Ss 
s 
ie) 
Z 


13 





Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation. Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. | 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what | 
lies beneath the | 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 














understandable. 











Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 








Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely, 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 





The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction, 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 























The ability to 
effectively 
communicate to a 
wide and diverse 
audience. 
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Date: September 15, 2016 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 


Assessment Coordinator: Bobbi Kay Lewis 

Assessment Coordinator’s email: bobbikay.lewis@okstate.edu 
Number of students enrolled in the program 2015-16: 330 
Number of students graduated in 2015-16: 116 


B. Program Mission Statement 


To educate the future leaders in mass communication from Oklahoma, its neighboring 
states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 


Oklahoma State University School of Media and Strategic Communications will do this 


by promoting: 
e Critical thinking 
e Creativity 
e Global awareness 
e Appreciation for the liberal arts 
e Adaptability 
e Problem solving skills 
e Diversity 
e Leadership 
e Community involvement 


C. University Assessment Funds 


Were university assessment funds used by the department/program for 
assessment activities? |] Yes [X|No 

If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 





D. Assessed Student Learning Outcomes 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues 
and ethical principles involved in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass 


communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass 
communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of 


mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 


and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management 


methods in mass communication. 


Assessment methods: 
Three assessment methods were used to evaluate the three learning outcomes: (1) Capstone 
Projects/Portfolios, (2) Internship Evaluation and (3) Senior Exit Interviews. 


Assessment Method 1 - Capstone Project/Portfolios: Students complete an online portfolio 
with artifacts created throughout the program and submit the portfolio to the instructor as part of 
their capstone class. At the advanced level, the artifacts available on the online portfolios of 
graduated students were used to assess the learning outcomes. The links to graduated 
students’ electronic portfolios were entered into a spreadsheet. Ten percent of the Spring 2016 
portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 112 
student portfolios received, 12 were selected for assessment for a total of 10%. External 
reviewers received the assessment rubric via Survey Monkey and the URL to the online 
portfolios. Capstone Project/Portfolios are evaluated using learning outcomes 4, 6 & 7. 
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The following scale was used to assess the Portfolios using learning outcomes 4, 6 and 7: 
(The assessment values are the same for all learning outcomes) 

1 = No or Poor representation of learning outcome; 

2 = Somewhat poor representation of learning outcome; 

3 = Average representation of learning outcome; 

4 = Good representation of learning outcome; 

5 = Outstanding representation of learning outcome. 

(See Appendix B for the Portfolio Assessment Grid) 


Assessment Method 2 - Internship Evaluation: Assessment reports of 9 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using learning 
outcomes 4, 6 & 7, which were also assessed by the Capstone Projects/Portfolios. (See 
Appendix C for Internship Evaluation Grid) 


D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. (See Appendix A for a list of 
courses) 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 4, which is slightly lower than the previous year (4.1). This 
indicated that portfolios provided better than average representation of this learning 
outcome with slight room for improvement. 








Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6, which is 
an improvement from last year’s score of 3.75. Three students (33%) demonstrated 
understanding occasionally; 3 (33%) demonstrated this learning outcome well but 
needed more work; 2 (22%) demonstrated it well, 1 student (11%) demonstrating 
understanding only slightly. 


The overall grade was 78% which is slightly lower than the previous year. 


D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. 


Opportunities for students to learn the student learning outcome: 

All students in Strategic Communication are required to take a course in Research 
Methods. All students are required to use research and data in their capstone project. 
They also need to have research skills to collect data for all their writing courses. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 3.67, which is a 
disappointing decline from last year’s overall mean score of (4.12). 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 5 based on 7- 
point scale. Four students (33%) demonstrated understanding occasionally; 2 (22%) 
demonstrated this learning outcome well but needed more work; 2 (22%) demonstrated 
it well, 1 student (11%) demonstrating understanding expertly. This demonstrates slight 
improvement over last year’s score of 4.0, and fewer internship evaluations were 
assessed last year. 


The overall grade for this learning outcome was 78% compared to 83% last year. These 
scores indicate room for improvement. 











D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 

In the Capstone Project/Portfolio assessment, this learning outcome assessed if the 
students’ work showed evidence of the ability to write clearly and without errors, craft 
language for interesting and effective communication, write across platforms effectively, 
and communicate to a wide and diverse audience. In the Internship assessment, 
internship supervisors only provide an overall assessment of the learning outcome. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program, in this case 
Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, Strategic Communications students are expected to 
demonstrate these skills in their capstone course through developing an SC campaign. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 4.08 (last year 3.65 
previously 3.53), which indicates growth and improvement of this learning outcome. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.5 based on 
a 7-point scale, which is a slight improvement from last year’s score of 4.3. One student 
(11%) did not demonstrate an understanding of the learning outcome; 1 (11%) students 
demonstrated understanding only slightly; 2 (22%) demonstrated understanding 
occasionally; 2 (22%) demonstrated this learning outcome well but needed more work, 3 
student (33%) demonstrated understanding well. These findings indicate instruction in 
this area is improving. 


The overall grade for this learning outcome was 80.5%. 





Assessment Method 3 - Senior Exit Interviews: The associate director of undergraduate 
studies conducted one-on-one interviews with seven outgoing Strategic Communications 
seniors. Students were randomly selected and asked to participate in the interviews. Embedded 
in the discussion were direct questions concerning the following learning outcomes: 


(D4) Learning outcome 1. Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Opportunities for students to learn the student learning outcome: 
All students are required to take the core courses in Mass Communication Law and 
Media Ethics. 


Summary of assessment evidence / results from the assessment method: 

Out of the seven students interviewed, six students communicated that they learned a 
great deal about constitutional freedoms and legal issues and one student felt that they 
struggled with the material. They felt good about their understanding of the First 
Amendment. Most of the students communicated that had a good understanding of 
ethical principles and several indicated that ethics was consistently covered in most of 
their major courses. Also, two of the students felt ethics was over-covered because they 
also learned about ethical principles in Philosophy courses. 


(D5) Learning outcome 2. Students will demonstrate an understanding of the relevance of 
human diversity in mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core course Media in a Diverse Society, which 
places considerable emphasis on the relevance of diversity in mass communications 
and the media. Also, the relevance of diversity is also covered in all of the Strategic 
Communications curriculum, including but not limited to Research Methods, Advertising 
Media & Markets, and SC Campaigns. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of diversity. 
They indicated that it was covered in most all of their major courses. Two of the students 
mentioned that they would have liked to have learned more strategies on how to 
communicate with diverse audiences. 


(D6) Learning outcome 3.Students will demonstrate respect for the history and social 
role of mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Mass Communication Law and Media Ethics. All of the courses include curricula on the 
history and social role of mass communications. In addition, strategic communications 
students are exposed to the history of Advertising, Public Relations and Strategic 
Communications in the Introduction to Strategic Communications course. Finally, an 
elective course in History of Mass Communications is consistently offered to students. 








Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of history and 
social role of mass communications, particularly in Public Relations and Advertising. 
Two of the students said they gained an understanding of the history and social role of 
mass communications in the Media in a Diverse Society course. 


(D7) Learning outcome 5. Students will demonstrate an understanding of the relevant 
theories and concepts of mass communication. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Electronic Communications, Mass Communication Law and Media Ethics. All of the 
courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and 
asked to apply to the relevant theories and concepts of Strategic Communications 
through most of the courses in SC, including the capstone course. 


Summary of assessment evidence / results from the assessment method: 

The students expressed less confidence in their knowledge of theoretical concepts than 
other learning outcomes. However, when asked specifically about theories and concepts 
used in strategic communications, they were quite confident in their understanding. 


(D8) Learning outcome 8. Students will demonstrate an understanding of relevant 
planning and management methods in mass communication. 


Opportunities for students to learn the student learning outcome: 

The following courses offer curriculum that emphasize the importance of relevant 
planning and management methods in mass communications, more specifically strategic 
communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Media, and SC Campaigns. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students discussed the importance of learning about planning and 
media management. They indicated they develop a good understanding of planning and 
management through the management and strategies course, the media planning 
(Advertising Media & Markets) course, and some mentioned the Advanced PR Media 
course. 








E. Summary of Assessment Results 


The portfolio process in the school is slowly being improved upon each year. The school now 
has a more systematic and thorough plan to assess student learning. The senior 
capstone/portfolio assessment was streamlined this year utilizing an electronic survey, making 
the process much easier for the professionals to complete. This year, senior exit interviews 
were added which improved the assessment process and allowed for better evaluation of the 
remaining 5 learning outcomes that were not assessed in the past 2 assessment cycles. The 
assessment plan calls for two additional methods which are being developed and administered 
for the 2016-17 academic year. 


The assessment results indicate that the students’ work is improving; each of the three 
outcomes assessed last year and this year improved from the previous year. However, the 
results indicate there is still room for improvement. The five learning outcomes that were newly 
assessed this year with the exit interviews cannot be compared to previous data, but the 
evaluation indicates the program is meeting most of the learning outcomes with room for 
improvement. 


The following steps were recommended last year, and there is now a clear plan to implement 
these steps in this coming assessment round: 


1. Administer the pre-test/post-test in MC 2003 (pre-test) and the end of the capstone 
course (post-test) in order to assess learning outcomes that are not easily demonstrated 
in the portfolios. The pre-test will be administered the first day of class in MC 2003 in 
Spring 2017. The post-test will be administered during the last two weeks of classes in 
the capstone course. The pre-test/post-test will be used to measure learning from the 
core curricula, which students in all 6 of the degree programs in SMSC are required to 
take, 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. This recommendation will be discussed with the faculty in the October 2016 
faculty meeting. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. The assessment plan/report will be brought 
to the curriculum committee to review and discuss possible curriculum changes. 


In addition to the steps mentioned above, an Alumni Survey should be developed and utilized 
as a method to assess the program and the preparedness for the media industry among SMSC 
graduates. 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Values 1-5 assess the QUALITY of 
learning outcome. Please assign the value of 1 if you cannot find any evidence that 
the learning outcome is represented. 


The assessment values are the same for all learning outcomes: 
1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 

4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 

















Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 























Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 





The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction, 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 




















The ability to 
effectively 
communicate toa 
wide and diverse 
audience. 
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Appendix C: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


Not applicable 

Not demonstrated 
Demonstrated only slightly 
Demonstrated occasionally 
Demonstrated but needs work 
Demonstrated well 

Expertly demonstrated 








1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 





2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 





5. An understanding of the relevant theories and concepts of 
mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 
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2015 - 2016 
Annual Assessment Report 


Bachelor of Science 
Strategic Communication 










Annual Assessment Report 


oxcanoma! M » School of Media and Strategic Communications 
i, f College of Arts & Sciences 
SE SET BS in Strategic Communications 
== j 
2015-2016 


Date: September 15, 2016 
Name of Person Submitting Report: Bobbi Kay Lewis 


A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 


Assessment Coordinator’s email: bobbikay.lewis @okstate.edu 
Number of students enrolled in the program 2015-16: 330 
Number of students graduated in 2015-16: 116 


B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 


states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 


Oklahoma State University School of Media and Strategic Communications will do this 
by promoting: 
e Critical thinking 
e Creativity 
e Global awareness 
e Appreciation for the liberal arts 
e Adaptability 
e Problem solving skills 
e Diversity 
e Leadership 
e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 


assessment activities? [_] Yes [X|No 

If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 





D. Assessed Student Learning Outcomes 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues 
and ethical principles involved in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass 


communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass 


communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of 


mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 


and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Assessment methods: 
Three assessment methods were used to evaluate the three learning outcomes: (1) Capstone 
Projects/Portfolios, (2) Internship Evaluation and (3) Senior Exit Interviews. 


Assessment Method 1 - Capstone Project/Portfolios: Students complete an online portfolio 
with artifacts created throughout the program and submit the portfolio to the instructor as part of 
their capstone class. At the advanced level, the artifacts available on the online portfolios of 
graduated students were used to assess the learning outcomes, The links to graduated 
students’ electronic portfolios were entered into a spreadsheet. Ten percent of the Spring 2016 
portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 112 
student portfolios received, 12 were selected for assessment for a total of 10%. External 
reviewers received the assessment rubric via Survey Monkey and the URL to the online 
portfolios. Capstone Project/Portfolios are evaluated using learning outcomes 4, 6 & 7. 





The following scale was used to assess the Portfolios using learning outcomes 4, 6 and 7: 
(The assessment values are the same for all learning outcomes) 
1 = No or Poor representation of learning outcome; 
2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 
4 = Good representation of learning outcome; 
5 = Outstanding representation of learning outcome. 
(See Appendix B for the Portfolio Assessment Grid) 


Assessment Method 2 - Internship Evaluation: Assessment reports of 9 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using learning 
outcomes 4, 6 & 7, which were also assessed by the Capstone Projects/Portfolios. (See 
Appendix C for Internship Evaluation Grid) 


D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. (See Appendix A for a list of 
courses) 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 4, which is slightly lower than the previous year (4.1). This 
indicated that portfolios provided better than average representation of this learning 
outcome with slight room for improvement. 








Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6, which is 
an improvement from last year’s score of 3.75. Three students (33%) demonstrated 
understanding occasionally; 3 (33%) demonstrated this learning outcome well but 
needed more work; 2 (22%) demonstrated it well, 1 student (11%) demonstrating 
understanding only slightly. 


The overall grade was 78% which is slightly lower than the previous year. 


D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 
In the intermediate assessment internship supervisors only provide an overall 
assessment of the learning outcome. 


In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. 


Opportunities for students to learn the student learning outcome: 

All students in Strategic Communication are required to take a course in Research 
Methods. All students are required to use research and data in their capstone project. 
They also need to have research skills to collect data for all their writing courses. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 3.67, which is a 
disappointing decline from last year’s overall mean score of (4.12). 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 5 based on 7- 
point scale. Four students (33%) demonstrated understanding occasionally; 2 (22%) 
demonstrated this learning outcome well but needed more work; 2 (22%) demonstrated 
it well, 1 student (11%) demonstrating understanding expertly. This demonstrates slight 
improvement over last year’s score of 4.0, and fewer internship evaluations were 
assessed last year. 


The overall grade for this learning outcome was 78% compared to 83% last year. These 
scores indicate room for improvement. 








D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 

In the Capstone Project/Portfolio assessment, this learning outcome assessed if the 
students’ work showed evidence of the ability to write clearly and without errors, craft 
language for interesting and effective communication, write across platforms effectively, 
and communicate to a wide and diverse audience. In the Internship assessment, 
internship supervisors only provide an overall assessment of the learning outcome. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program, in this case 
Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, Strategic Communications students are expected to 
demonstrate these skills in their capstone course through developing an SC campaign. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 4.08 (last year 3.65 
previously 3.53), which indicates growth and improvement of this learning outcome. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.5 based on 
a 7-point scale, which is a slight improvement from last year’s score of 4.3. One student 
(11%) did not demonstrate an understanding of the learning outcome; 1 (11%) students 
demonstrated understanding only slightly; 2 (22%) demonstrated understanding 
occasionally; 2 (22%) demonstrated this learning outcome well but needed more work, 3 
student (33%) demonstrated understanding well. These findings indicate instruction in 
this area is improving. 


The overall grade for this learning outcome was 80.5%. 





Assessment Method 3 - Senior Exit Interviews: The associate director of undergraduate 
studies conducted one-on-one interviews with seven outgoing Strategic Communications 
seniors. Students were randomly selected and asked to participate in the interviews. Embedded 
in the discussion were direct questions concerning the following learning outcomes: 


(D4) Learning outcome 1. Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Opportunities for students to learn the student learning outcome: 
All students are required to take the core courses in Mass Communication Law and 
Media Ethics. 


Summary of assessment evidence / results from the assessment method: 

Out of the seven students interviewed, six students communicated that they learned a 
great deal about constitutional freedoms and legal issues and one student felt that they 
struggled with the material. They felt good about their understanding of the First 
Amendment. Most of the students communicated that had a good understanding of 
ethical principles and several indicated that ethics was consistently covered in most of 
their major courses. Also, two of the students felt ethics was over-covered because they 
also learned about ethical principles in Philosophy courses. 


(D5) Learning outcome 2. Students will demonstrate an understanding of the relevance of 
human diversity in mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core course Media in a Diverse Society, which 
places considerable emphasis on the relevance of diversity in mass communications 
and the media. Also, the relevance of diversity is also covered in all of the Strategic 
Communications curriculum, including but not limited to Research Methods, Advertising 
Media & Markets, and SC Campaigns. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of diversity. 
They indicated that it was covered in most all of their major courses. Two of the students 
mentioned that they would have liked to have learned more strategies on how to 
communicate with diverse audiences. 


(D6) Learning outcome 3.Students will demonstrate respect for the history and social 
role of mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Mass Communication Law and Media Ethics. All of the courses include curricula on the 
history and social role of mass communications. In addition, strategic communications 
students are exposed to the history of Advertising, Public Relations and Strategic 
Communications in the Introduction to Strategic Communications course. Finally, an 
elective course in History of Mass Communications is consistently offered to students. 











Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of history and 
social role of mass communications, particularly in Public Relations and Advertising. 
Two of the students said they gained an understanding of the history and social role of 
mass communications in the Media in a Diverse Society course. 


(D7) Learning outcome 5. Students will demonstrate an understanding of the relevant 
theories and concepts of mass communication. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Electronic Communications, Mass Communication Law and Media Ethics. All of the 
courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and 
asked to apply to the relevant theories and concepts of Strategic Communications 
through most of the courses in SC, including the capstone course. 


Summary of assessment evidence / results from the assessment method: 

The students expressed less confidence in their knowledge of theoretical concepts than 
other learning outcomes. However, when asked specifically about theories and concepts 
used in strategic communications, they were quite confident in their understanding. 


(D8) Learning outcome 8. Students will demonstrate an understanding of relevant 
planning and management methods in mass communication. 


Opporiunities for students to learn the student learning outcome: 

The following courses offer curriculum that emphasize the importance of relevant 
planning and management methods in mass communications, more specifically strategic 
communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Media, and SC Campaigns. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students discussed the importance of learning about planning and 
media management. They indicated they develop a good understanding of planning and 
management through the management and strategies course, the media planning 
(Advertising Media & Markets) course, and some mentioned the Advanced PR Media 
course. 











E. Summary of Assessment Results 


The portfolio process in the school is slowly being improved upon each year. The school now 
has a more systematic and thorough plan to assess student learning. The senior 
capstone/portfolio assessment was streamlined this year utilizing an electronic survey, making 
the process much easier for the professionals to complete. This year, senior exit interviews 
were added which improved the assessment process and allowed for better evaluation of the 
remaining 5 learning outcomes that were not assessed in the past 2 assessment cycles. The 
assessment plan calls for two additional methods which are being developed and administered 
for the 2016-17 academic year. 


The assessment results indicate that the students’ work is improving; each of the three 
outcomes assessed last year and this year improved from the previous year. However, the 
results indicate there is still room for improvement. The five learning outcomes that were newly 
assessed this year with the exit interviews cannot be compared to previous data, but the 
evaluation indicates the program is meeting most of the learning outcomes with room for 
improvement. 


The following steps were recommended last year, and there is now a clear plan to implement 
these steps in this coming assessment round: 


1. Administer the pre-test/post-test in MC 2003 (pre-test) and the end of the capstone 
course (post-test) in order to assess learning outcomes that are not easily demonstrated 
in the portfolios. The pre-test will be administered the first day of class in MC 2003 in 
Spring 2017. The post-test will be administered during the last two weeks of classes in 
the capstone course. The pre-test/post-test will be used to measure learning from the 
core curricula, which students in all 6 of the degree programs in SMSC are required to 
take. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. This recommendation will be discussed with the faculty in the October 2016 
faculty meeting. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. The assessment plan/report will be brought 
to the curriculum committee to review and discuss possible curriculum changes. 


In addition to the steps mentioned above, an Alumni Survey should be developed and utilized 
as a method to assess the program and the preparedness for the media industry among SMSC 
graduates. 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 


INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Values 1-5 assess the QUALITY of 
learning outcome. Please assign the value of 1 if you cannot find any evidence that 
the learning outcome is represented. 


The assessment values are the same for all learning outcomes: 

1=No or Poor representation of learning outcome; 
=Somewhat poor representation of learning outcome; 

3=Average representation of learning outcome; 

4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 











Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 
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Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 











The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 














The ability to 
effectively 
communicate toa 
wide and diverse 
audience. 
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Appendix C: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


Not applicable 








6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 


Not demonstrated 


Demonstrated only slightly 


Demonstrated occasionally 


Demonstrated but needs work 








Demonstrated well 


Expertly demonstrated 
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A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 


Assessment Coordinator’s email: bobbikay.lewis @okstate.edu 
Number of students enrolled in the program 2015-16: 152 
Number of students graduated in 2015-16: 52 


B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 


states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 


Oklahoma State University School of Media and Strategic Communications will do this 


by promoting: 
e Critical thinking 
e Creativity 
e Global awareness 
e Appreciation for the liberal arts 
e Adaptability 
e Problem solving skills 
e Diversity 
e Leadership 
e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 


assessment activities? [] Yes [X|No 

If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 








D. Assessed Student Learning Outcomes 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues 
and ethical principles involved in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass 


communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass 
communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of 


mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 
and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Assessment methods: 
Three assessment methods were used to evaluate the three learning outcomes: (1) Capstone 
Projects/Portfolios, (2) Internship Evaluation and (3) Senior Exit Interviews. 


Assessment Method 1 - Capstone Project/Portfolios: Students complete an online portfolio 
with artifacts created throughout the program and submit the portfolio to the instructor as part of 
their capstone class. At the advanced level, the artifacts available on the online portfolios of 
graduated students were used to assess the learning outcomes. The links to graduated 
students’ electronic portfolios were entered into a spreadsheet. Twenty percent of the Spring 
2016 portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 52 
student portfolios, 10 were selected for assessment for a total of 19%. Three external reviewers 
received the assessment rubric via Survey Monkey and the URLs to the sample of online 
portfolios. 





The following scale was used to assess learning outcomes 4, 6 and 7: 
(The assessment values are the same for all learning outcomes) 
1 = No or Poor representation of learning outcome; 
2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 
4 = Good representation of learning outcome; 
5 = Outstanding representation of learning outcome. 


Assessment Method 2 - Internship Evaluation: Assessment reports of 5 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using the same 
three learning outcomes listed above, which were also assessed by the Capstone 
Projects/Portfolios. (See appendix A for Internship Evaluation Grid) 


D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. In the internship assessment internship supervisors only 
provide an overall assessment of the learning outcome. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 4.25, which is higher than the previous year (3.5). This indicated 
that portfolios provided better than average representation of this learning outcome with 
slight room for improvement. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.8 on a 
7-point scale. Of these 2 students (40%) occasionally, 2 (40%) demonstrated this 
learning outcome well but needed more work and 1 (20%) demonstrated it well. This is 
the same percentage as last year. 








The overall grade was 77% compared to 64% the previous year. 


D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. In the internship 
assessment, internship supervisors only provide an overall assessment of the learning 
outcome. 


Opportunities for students to learn the student learning outcome: 

All students in Sports Media are incorporate information gathering and sports data 
analysis in their writing courses. All students are required to use data in their capstone 
project. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 4.47, which was 
higher than last year (3.15) and indicated that portfolios provided an improved 
representation of this learning outcome with room for continued improvement. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6 based on 
a 7-point scale. Two students (40%) demonstrated this well, 2 students (40%) 
demonstrated this learning outcome occasionally and 1 student (20%) demonstrated this 
learning outcome only slightly. 


The overall grade for this learning outcome was 76% compared to 62% last year and 
45% the previous. This grade demonstrates consistent improvement from the previous 
two years. 








D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 
In the indirect measure Internship Evaluation, internship supervisors only provide an 
overall assessment of the learning outcome. 


In the Capstone Project/Portfolio assessment, this learning outcome assessed if the 
students’ work showed evidence of the ability to write clearly and without errors, craft 
language for interesting and effective communication, write across platforms effectively, 
and communicate to a wide and diverse audience. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program. Sports Strat 
Comm majors include: Persuasive Writing and Sports PR. Sports Journalism majors 
include: Reporting, Electronic Sports Reporting, Editing, Data Journalism and Sports 
Writing. Sports production majors include: Reporting, Electronic Sports Reporting, and 
editing in production courses. In addition, Sports Media students are expected to show 
these skills in their capstone course. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 4.28 (last year 3.5, 
previously 2.4), which indicated that this learning outcome was represented in the 
portfolios and demonstrates considerable improvement from last year and the year 
before. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 5.2 on 7-point 
scale. This is a moderate improvement from last year. Two (40%) of interns occasionally 
demonstrated these skills and three (60%) demonstrated this well. 


The overall grade for this learning outcome was 79% compared to 70% last year and 
48% the previous year. Again these finding indicate consistent improvement. 





Assessment Method 3 - Senior Exit Interviews: The associate director of undergraduate 
studies conducted one-on-one interviews with 5 outgoing Sports Media seniors. Students were 
randomly selected and asked to participate in the interviews. Embedded in the discussion were 
direct questions concerning the following learning outcomes: 


(D4) Learning outcome 1. Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Opportunities for students to learn the student learning outcome: 
All students are required to take the core courses in Mass Communication Law and 
Media Ethics. 


Summary of assessment evidence / results from the assessment method: 

Out of the five students interviewed, all five students communicated that they learned a 
great deal about constitutional freedoms and legal issues. They felt good about their 
understanding of the First Amendment. However, two of the students communicated that 
ethical principles were not heavily emphasized and felt hesitant in their mastery of that 
content. 


(D5) Learning outcome 2. Students will demonstrate an understanding of the relevance of 
human diversity in mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core course Media in a Diverse Society, which 
places considerable emphasis on the relevance of diversity in mass communications 
and the media. Also, the relevance of diversity is also covered in all of the Sports Media 
curriculum, including but not limited to Sports in the Media and Contemporary Sports 
Media. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of diversity. 
They indicated that it was covered in most all of their major courses. One of the students 
mentioned that the topic was discussed at length in two of his SPM classes. 


(D6) Learning outcome 3. Students will demonstrate respect for the history and social 
role of mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Mass Communication Law and Media Ethics. All of the courses include curricula on the 
history and social role of mass communications. In addition, Sports Media students are 
exposed to the history of sports media in the Sports in the Media course. Finally, an 
elective course in History of Mass Communications is consistently offered to students. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of history and 
social role of mass communications. They indicated that it was covered in the Media in a 
Divers Society course. Two of the students mentioned that it was discussed in many of 
their major courses. 





(D7) Learning outcome 5. Students will demonstrate an understanding of the relevant 
theories and concepts of mass communication. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Electronic Communications, Mass Communication Law and Media Ethics. All of the 
courses include material on the relevant theories and concepts of mass 
communications. In addition, Sports Media students are exposed to and asked to apply 
to the relevant theories and concepts of Sports Media through most of the courses in 
SPM, including the capstone course. 


Summary of assessment evidence / results from the assessment method: 

The students interviewed mentioned very little about media theories or theoretical 
concepts. When asked about it, three of the students said they remember theories such 
as agenda setting and framing being discussed. Two of the students offered very little 
confirmation that they had a grasp of relevant theories in mass communication. 


(D8) Learning outcome 8. Students will demonstrate an understanding of relevant 
planning and management methods in mass communication. 


Opportunities for students to learn the student learning outcome: 

The following courses offer curriculum that emphasize the importance of relevant 
planning and management methods in mass communications, more specifically Sports 
Media: Sports PR, Contemporary Sports media, Sports Writing, Data Journalism and all 
of the production courses. 


Summary of assessment evidence / results from the assessment method: 
Three of students discussed the importance of learning about planning and media 
management. Two of the students were less forthcoming about the topic, but when 
probed they indicated that they learned the importance of planning in writing and 
electronic storytelling. 





E. Summary of Assessment Results 


The portfolio process in the school is slowly being improved upon each year. The school now 
has a more systematic and thorough plan to assess student learning. The senior 
capstone/portfolio assessment was streamlined this year utilizing an electronic survey, making 
the process much easier for the professionals to complete. This year, senior exit interviews 
were added which improved the assessment process and allowed for better evaluation of the 
remaining 5 learning outcomes that were not assessed in the past 2 assessment cycles. The 
assessment plan calls for two additional methods which are being developed and administered 
for the 2016-17 academic year. 


The assessment results indicate that the students’ work is improving; each of the three 
outcomes assessed last year and this year improved from the previous year. However, the 
results indicate there is still room for improvement. The five learning outcomes that were newly 
assessed this year with the exit interviews cannot be compared to previous data, but the 
evaluation indicates the program is meeting most of the learning outcomes with room for 
improvement. 


The following steps were recommended last year, and there is now a clear plan to implement 
these steps in this coming assessment round: 


1. Administer the pre-test/post-test in MC 2003 (pre-test) and the end of the capstone 
course (post-test) in order to assess learning outcomes that are not easily demonstrated 
in the portfolios. The pre-test will be administered the first day of class in MC 2003 in 
Spring 2017. The post-test will be administered during the last two weeks of classes in 
the capstone course. The pre-test/post-test will be used to measure learning from the 
core curricula, which students in all 6 of the degree programs in SMSC are required to 
take. 

2. All portfolios need to be reviewed at different levels and in different classes. Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. This recommendation will be discussed with the faculty in the October 2016 
faculty meeting. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. The assessment plan/report will be brought 
to the curriculum committee to review and discuss possible curriculum changes. 


In addition to the steps mentioned above, an Alumni Survey should be developed and utilized 
as a method to assess the program and the preparedness for the media industry among SMSC 
graduates. 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Values 1-5 assess the QUALITY of 
learning outcome. Please assign the value of 1 if you cannot find any evidence that 
the learning outcome is represented. 


The assessment values are the same for all learning outcomes: 
1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 

4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 

















Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 








accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 
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Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely, 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 








The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction, 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 




















The ability to 
effectively 
communicate toa 
wide and diverse 
audience. 
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Appendix C: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


5. An understanding of the relevant theories and concepts of 
mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 





8. An understanding of relevant planning and management 
methods in mass communications. 
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Not applicable 


Not demonstrated 


Demonstrated only slightly 


Demonstrated occasionally 


Demonstrated but needs work 


Demonstrated well 


Expertly demonstrated 








Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 


presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation. Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 














understandable, 








Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 





Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 








The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication, 
The ability to write 
across platforms 
effectively. 

















The ability to 
effectively 
communicate to a 
wide and diverse 
audience, 
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A. Program Information 
Assessment Coordinator: Bobbi Kay Lewis 


Assessment Coordinator’s email: bobbikay.lewis@okstate.edu 
Number of students enrolled in the program 2015-16: 152 
Number of students graduated in 2015-16: 52 


B. Program Mission Statement 
To educate the future leaders in mass communication from Oklahoma, its neighboring 


states, the nation and the world to be responsible and effective communicators who 
facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong 
learning. 


Oklahoma State University School of Media and Strategic Communications will do this 
by promoting: 

e Critical thinking 

e Creativity 
Global awareness 
Appreciation for the liberal arts 
Adaptability 
Problem solving skills 
Diversity 
Leadership 
Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for 


assessment activities? |] Yes [X|No 

If university assessment funds were used by the department or program, describe how 
university assessment funds were used and the contribution the funds had on the 
assessment process. Funding requests for the next academic year have a separate 
process and should not be included here. 





D. Assessed Student Learning Outcomes 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues 
and ethical principles involved in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass 


communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass 
communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to 
individual disciplines in mass communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of 


mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research 


and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production 
techniques of mass communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Assessment methods: 
Three assessment methods were used to evaluate the three learning outcomes: (1) Capstone 
Projects/Portfolios, (2) Internship Evaluation and (3) Senior Exit Interviews. 


Assessment Method 1 - Capstone Project/Portfolios: Students complete an online portfolio 
with artifacts created throughout the program and submit the portfolio to the instructor as part of 
their capstone class. At the advanced level, the artifacts available on the online portfolios of 
graduated students were used to assess the learning outcomes. The links to graduated 
students’ electronic portfolios were entered into a spreadsheet. Twenty percent of the Spring 
2016 portfolios were selected using the online randomizing tool, Randomizer. Thus, of the 52 
student portfolios, 10 were selected for assessment for a total of 19%. Three external reviewers 
received the assessment rubric via Survey Monkey and the URLs to the sample of online 
portfolios. 








The following scale was used to assess learning outcomes 4, 6 and 7: 
(The assessment values are the same for all learning outcomes) 
1 = No or Poor representation of learning outcome; 
2 = Somewhat poor representation of learning outcome; 
3 = Average representation of learning outcome; 
4 = Good representation of learning outcome; 
5 = Outstanding representation of learning outcome. 


Assessment Method 2 - Internship Evaluation: Assessment reports of 5 students’ internship 
advisers were collected and data analyzed. Student internships are evaluated using the same 
three learning outcomes listed above, which were also assessed by the Capstone 
Projects/Portfolios. (See appendix A for Internship Evaluation Grid) 


D1). Student Learning Outcome 4. Students will demonstrate critical, creative and 
independent thinking as they relate to individual disciplines in mass communication. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work 
reflected the ability to analyze complex situations accurately, to craft innovative solutions 
to difficult problems, to look beyond the obvious, and the ability to effectively 
communicate complex ideas. In the internship assessment internship supervisors only 
provide an overall assessment of the learning outcome. 


Opportunities for students to learn the student learning outcome: 

This learning outcome is likely the most important component in all the courses in the 
degree. Students are challenged in their writing and reporting courses to critically assess 
information before presenting in the form of written artifacts. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating critical, creative and 
individual thinking was 4.25, which is higher than the previous year (3.5). This indicated 
that portfolios provided better than average representation of this learning outcome with 
slight room for improvement. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.8 on a 
7-point scale. Of these 2 students (40%) occasionally, 2 (40%) demonstrated this 
learning outcome well but needed more work and 1 (20%) demonstrated it well. This is 
the same percentage as last year. 





The overall grade was 77% compared to 64% the previous year. 


D2). Student Learning Outcome 6. Students will demonstrate an understanding of the 
methods and techniques of research and information gathering. 


Assessment method used: 

In the portfolio assessment this learning outcome assessed if the students’ work showed 
evidence of the ability to gather information effectively and competently, initiative and 
creativity in information gathering, to use multiple methods and sources for research, 
and to effectively communicate how the information was gathered. In the internship 
assessment, internship supervisors only provide an overall assessment of the learning 
outcome. 


Opportunities for students to learn the student learning outcome: 

All students in Sports Media are incorporate information gathering and sports data 
analysis in their writing courses. All students are required to use data in their capstone 
project. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating an understanding of 
methods and techniques of research in mass communication was 4.47, which was 
higher than last year (3.15) and indicated that portfolios provided an improved 
representation of this learning outcome with room for continued improvement. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 4.6 based on 
a 7-point scale. Two students (40%) demonstrated this well, 2 students (40%) 
demonstrated this learning outcome occasionally and 1 student (20%) demonstrated this 
learning outcome only slightly. 


The overall grade for this learning outcome was 76% compared to 62% last year and 
45% the previous. This grade demonstrates consistent improvement from the previous 
two years. 








D3). Student Learning Outcome 7. Students will demonstrate an understanding of the 
writing, editing and production techniques of mass communication specialties. 


Assessment method used: 
In the indirect measure Internship Evaluation, internship supervisors only provide an 
overall assessment of the learning outcome. 


In the Capstone Project/Portfolio assessment, this learning outcome assessed if the 
students’ work showed evidence of the ability to write clearly and without errors, craft 
language for interesting and effective communication, write across platforms effectively, 
and communicate to a wide and diverse audience. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core courses in Style and Structure and Electronic 
Communication, and writing-specific courses in their degree program. Sports Strat 
Comm majors include: Persuasive Writing and Sports PR. Sports Journalism majors 
include: Reporting, Electronic Sports Reporting, Editing, Data Journalism and Sports 
Writing. Sports production majors include: Reporting, Electronic Sports Reporting, and 
editing in production courses. In addition, Sports Media students are expected to show 
these skills in their capstone course. 


Summary of assessment evidence / results from the assessment method: 

Portfolio evaluations used a 5-point scale with 1equaling no or poor representation of the 
learning outcome and 5 equaling outstanding representation of the learning outcome. 
Internship evaluations used a scale of 1-7, using the following criteria: 

1 = Not Applicable; 2 = Understanding Not Demonstrated; 3 = Demonstrated Only 
Slightly; 4 = Demonstrated Occasionally, 5 = Demonstrated But Needs Work; 6 = 
Demonstrated Well; and 7 = Expertly Demonstrated. 


Portfolio assessment: 

The overall mean score for this learning outcome of demonstrating appropriate writing, 
editing and production techniques in mass communication was 4.28 (last year 3.5, 
previously 2.4), which indicated that this learning outcome was represented in the 
portfolios and demonstrates considerable improvement from last year and the year 
before. 


Internship assessment: 

The mean score for students’ understanding of this learning outcome was 5.2 on 7-point 
scale. This is a moderate improvement from last year. Two (40%) of interns occasionally 
demonstrated these skills and three (60%) demonstrated this well. 


The overall grade for this learning outcome was 79% compared to 70% last year and 
48% the previous year. Again these finding indicate consistent improvement. 





Assessment Method 3 - Senior Exit Interviews: The associate director of undergraduate 
studies conducted one-on-one interviews with 5 outgoing Sports Media seniors. Students were 
randomly selected and asked to participate in the interviews. Embedded in the discussion were 
direct questions concerning the following learning outcomes: 


(D4) Learning outcome 1. Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Opportunities for students to learn the student learning outcome: 
All students are required to take the core courses in Mass Communication Law and 
Media Ethics. 


Summary of assessment evidence / results from the assessment method: 

Out of the five students interviewed, all five students communicated that they learned a 
great deal about constitutional freedoms and legal issues. They felt good about their 
understanding of the First Amendment. However, two of the students communicated that 
ethical principles were not heavily emphasized and felt hesitant in their mastery of that 
content. 


(D5) Learning outcome 2. Students will demonstrate an understanding of the relevance of 
human diversity in mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the core course Media in a Diverse Society, which 
places considerable emphasis on the relevance of diversity in mass communications 
and the media. Also, the relevance of diversity is also covered in all of the Sports Media 
curriculum, including but not limited to Sports in the Media and Contemporary Sports 
Media. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of diversity. 
They indicated that it was covered in most all of their major courses. One of the students 
mentioned that the topic was discussed at length in two of his SPM classes. 


(D6) Learning outcome 3. Students will demonstrate respect for the history and social 
role of mass communications. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Mass Communication Law and Media Ethics. All of the courses include curricula on the 
history and social role of mass communications. In addition, Sports Media students are 
exposed to the history of sports media in the Sports in the Media course. Finally, an 
elective course in History of Mass Communications is consistently offered to students. 


Summary of assessment evidence / results from the assessment method: 

The majority of the students expressed an understanding of the relevance of history and 
social role of mass communications. They indicated that it was covered in the Media in a 
Divers Society course. Two of the students mentioned that it was discussed in many of 
their major courses. 





(D7) Learning outcome 5. Students will demonstrate an understanding of the relevant 
theories and concepts of mass communication. 


Opportunities for students to learn the student learning outcome: 

All students are required to take the following core courses: Media in a Diverse Society, 
Electronic Communications, Mass Communication Law and Media Ethics. All of the 
courses include material on the relevant theories and concepts of mass 
communications. In addition, Sports Media students are exposed to and asked to apply 
to the relevant theories and concepts of Sports Media through most of the courses in 
SPM, including the capstone course. 


Summary of assessment evidence / results from the assessment method: 

The students interviewed mentioned very little about media theories or theoretical 
concepts. When asked about it, three of the students said they remember theories such 
as agenda setting and framing being discussed. Two of the students offered very little 
confirmation that they had a grasp of relevant theories in mass communication. 


(D8) Learning outcome 8. Students will demonstrate an understanding of relevant 
planning and management methods in mass communication. 


Opportunities for students to learn the student learning outcome: 

The following courses offer curriculum that emphasize the importance of relevant 
planning and management methods in mass communications, more specifically Sports 
Media: Sports PR, Contemporary Sports media, Sports Writing, Data Journalism and all 
of the production courses. 


Summary of assessment evidence / results from the assessment method: 
Three of students discussed the importance of learning about planning and media 
management. Two of the students were less forthcoming about the topic, but when 
probed they indicated that they learned the importance of planning in writing and 
electronic storytelling. 








E. Summary of Assessment Results 


The portfolio process in the school is slowly being improved upon each year. The school now 
has a more systematic and thorough plan to assess student learning. The senior 
capstone/portfolio assessment was streamlined this year utilizing an electronic survey, making 
the process much easier for the professionals to complete. This year, senior exit interviews 
were added which improved the assessment process and allowed for better evaluation of the 
remaining 5 learning outcomes that were not assessed in the past 2 assessment cycles. The 
assessment plan calls for two additional methods which are being developed and administered 
for the 2016-17 academic year. 


The assessment results indicate that the students’ work is improving; each of the three 
outcomes assessed last year and this year improved from the previous year. However, the 
results indicate there is still room for improvement. The five learning outcomes that were newly 
assessed this year with the exit interviews cannot be compared to previous data, but the 
evaluation indicates the program is meeting most of the learning outcomes with room for 
improvement. 


The following steps were recommended last year, and there is now a clear plan to implement 
these steps in this coming assessment round: 


1. Administer the pre-test/post-test in MC 2003 (pre-test) and the end of the capstone 
course (post-test) in order to assess learning outcomes that are not easily demonstrated 
in the portfolios. The pre-test will be administered the first day of class in MC 2003 in 
Spring 2017. The post-test will be administered during the last two weeks of classes in 
the capstone course. The pre-test/post-test will be used to measure learning from the 
core curricula, which students in all 6 of the degree programs in SMSC are required to 
take. 

2. All portfolios need to be reviewed at different levels and in different classes, Where 
possible, each course should produce a portfolio artifact that can add to our students’ 
knowledge and understanding of the three learning outcomes assessed using the 
portfolio. This recommendation will be discussed with the faculty in the October 2016 
faculty meeting. 

3. An assessment plan needs to be developed for utilizing the assessment data to adjust 
the curriculum to better serve the students. The assessment plan/report will be brought 
to the curriculum committee to review and discuss possible curriculum changes. 


In addition to the steps mentioned above, an Alumni Survey should be developed and utilized 
as a method to assess the program and the preparedness for the media industry among SMSC 
graduates. 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 





INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Values 1-5 assess the QUALITY of 
learning outcome. Please assign the value of 1 if you cannot find any evidence that 
the learning outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 











Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 
The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 
understandable. 
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Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 








The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication, 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction. 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication, 
The ability to write 
across platforms 
effectively. 





























The ability to 
effectively 
communicate to a 
wide and diverse 
audience. 
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Appendix C: INTERNSHIP EVALUATION TABLE 


To what extent does the intern demonstrate the following 
characteristics? 


Not applicable 
Not demonstrated 


Demonstrated only slightly 
Demonstrated occasionally 


1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


Demonstrated but needs work 


Demonstrated well 








6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 


Expertly demonstrated 








8. An understanding of relevant planning and management 
methods in mass communications. 
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Appendix B: Learning Outcomes Assessment Portfolio Assessment Rubric 


School of Media and Strategic Communications 
Learning Outcomes Assessment Portfolio Assessment Rubric 


Name of reviewer: 


INSTRUCTIONS: Please assess each of the learning outcomes based on the artifacts 
presented in the portfolios assigned to you. Merely place an X in the cell that best 
represents your evaluation. Values 1-5 assess the QUALITY of learning outcome. 
Please assign the value of 1 if you cannot find any evidence that the learning 
outcome is represented. 


The assessment values are the same for all learning outcomes: 


1=No or Poor representation of learning outcome; 
2=Somewhat poor representation of learning outcome; 
3=Average representation of learning outcome; 
4=Good representation of learning outcome; 

5= Outstanding representation of learning outcome. 


Kindly tally the values you assigned for each learning outcome and add the total 
score to the space provided for Overall Score. 


Learning outcome 4: 


Demonstrate critical, creative and individual thinking. Overall Score: 


Quality of evidence 
of learning 
outcome 

The ability to 
analyze complex 
situations 
accurately. 

The ability to craft 
innovative 
solutions to 
difficult problems. 
The ability to look 
beyond what is 
obvious and 
understand what 
lies beneath the 
surface. 

The ability to 
effectively 
communicate 
complex ideas and 
make them 














understandable, [| o | aes 


Learning outcome 6: 


Demonstrate an understanding of the methods and techniques of research and information gathering. 


Overall Score: 


Quality of 
evidence of 
learning outcome 
Evidence of the 
ability to gather 
information 
effectively and 
completely. 
Evidence of 
initiative and 
creativity in 
information 
gathering. 

The ability to use 
multiple methods 
and sources to 
research 
information. 


The ability to 
effectively 
communicate how 
information was 
gathered. 
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Learning outcome 7: 


Demonstrate appropriate writing, editing and production techniques in mass communication. 


Overall Score 


Quality of evidence 
of learning 
outcome 

Evidence of the 
ability to write 
clearly, without 
errors in grammar 
or construction, 
Evidence of the 
ability to craft 
language for 
interesting and 
effective 
communication. 
The ability to write 
across platforms 
effectively. 








The ability to 
effectively 
communicate to a 
wide and diverse 
audience. 
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2016 - 2017 
Annual Assessment Report 


Bachelor of Science 
Strategic Communication 





|ala School of Media & Strategic Communication 
Strategic Communications — Bachelor of Science 
Assessment Report Form 2016-2017 


om VERSITY. 





Date of Report: 8/30/2017 


Name of Person Submitting Report: Gina J. Noble, Associate Director of Undergraduate Studies, School of 
Media & Strategic Communications 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2016-2017: 210 
Number of students graduated in 2016-2017: 77 


B. Program Mission Statement 


To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence 
in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University 
School of Media & Strategic Communications will do this by promoting: 

O Critical thinking 


Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 


ta Ss! ea a) an E 


Community involvement 


C. University Assessment Funds 


Were university assessment funds used by the department/program for assessment activities? XYes ONo 

Funds were used to pay SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working 
professionally at least three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s 
three programs). Funds were also used to pay one SMSC professor to assess the same portfolios. The funds helped legitimize the 
importance of SMSC’s assessment research to participating alumni because they took their jobs seriously and gave in-depth answers 
to help us better understand our students’ strengths and weaknesses, which helps faculty improve curricula, One-hundred percent 
of the selected participants completed the survey. 








D. Student Learning Outcomes 


NOTE...We have two degrees in strategic communications: a Bachelor of Science and a Bachelor of Arts. The only difference 


between the two is a foreign-language requirement in the Bachelor of Arts, 


NOTE...The following student learning outcomes are the same for each of the six degrees in the School of Media & Strategic 
Communication because of accreditation requirements set by our accrediting council — the Accrediting Council on Education 


in Journalism and Mass Communication http://www.acejme.org/policies-process/nine-standards/ 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 


communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 


communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass communication 


specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass communication. 














Assessment Method #1 — Graduating Senior Survey and Exit Interviews 





Learning Outcomes 1, 2, 3, 5, 8 


D1) Student Learning Outcome #1; Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

Students are required to take MC 2003, Media in a Diverse Society, which devotes one-two lectures introducing media law and the 
ethical considerations professionals in the field may face. Students are required to take MC 4163, Mass Communication Law, and MC 
4143, Ethics and Issues in Mass Communication; both classes cover this student-learning outcome. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Using a “graduating seniors” list provided by academic counselors, 10 SC names were randomly selected using 
www.randomizer,com, Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 
then selected using the randomizer software. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OSatisfaction Survey Xinterviews 
ORating of skills (e.g., rubrics) O Benchmarking CPerformance or jury 
OAnalysis of written artifacts O Measuring effectiveness relative to Oisual collection (photos, videos, etc.) 
CIComprehensive, certification, or professional standards CReview of student research 
professional exam(s) CReview of thesis/dissertation/ creative (Other (please specify): 
OOral presentation component 
CCourse project C Capstone project 
OInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 

The assessment coordinator / associate director conducted five SC senior exit interviews. 

First, they were asked to take a survey for Learning Outcomes (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to 
measure Learning Outcomes (see appendix). 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 

The goal was to receive a mean score of at least 4 (out of 5) on each question on the senior exit survey, which would indicate that 
graduating seniors “agree” they understand and have an appreciation for the constitutional freedoms, legal issues and ethical 
considerations involved in mass communication. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 1. 
Learning Outcome #1 score: 4.4 out of 5 points. Goal achieved. 


The scale ratings included: 
5 — strongly agree 4-agree 3 —neutral 2 — disagree 1- strongly disagree 


What do the results suggest about student achievement of this learning outcome? 





The score indicates students were very satisfied with their knowledge of constitutional freedoms, legal issues and ethical principles 
in mass communication. Three students “strongly agreed” they had a good understanding of the First Amendment, one student 
“agreed” she was more comfortable discussing constitutional freedoms and legal issues that are media related, and one student was 
“neutral” regarding her understanding of this Learning Outcome. 


During the interview, all students agreed they have gained knowledge during their coursework regarding constitutional freedoms 
and ethical principles. All students recalled hearing about law and ethics in multiple classes. Two said they struggled to understand 
ethical principles taught in SMSC, but they had learned about same ethical principles in Philosophy and Religion, which made them 
more comfortable using the theories. Another student said she felt the ethical principles were repeated in Introduction to Strategic 
Communications, Religion and Ethics — she said she was thankful to hear the principles repeated across classes and departments. 


The School should continue to discuss constitutional freedoms and ethical considerations across its curriculum, and more classes 
should include ethical principles if possible. 


D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

All SMSC students are required to take the core course, Media In A Diverse Society, which places considerable emphasis on the 
relevance of diversity in mass communications and the media. Diversity is also covered in the Introduction to Strategic Communications 
required course, which all strategic communication majors are required to take. Many courses in strategic communications discuss 
diversity, including Persuasive Writing, Graphic Design, Research Methods, Campaigns and Media & Markets. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Using a “graduating seniors” list provided by academic counselors, 10 SC names were randomly selected using www.randomizer.com. 
Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were then selected using the 
randomizer software. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey DSatisfaction Survey llnterviews 
ORating of skills (e.g., rubrics) Benchmarking OPerformance or jury 
CAnalysis of written artifacts C Measuring effectiveness relative to DVisual collection (photos, videos, etc.) 
Licomprehensive, certification, or professional standards C Review of student research 
professional exam(s) CReview of thesis/dissertation/ creative COther (please specify): 
LOral presentation component Click here to specify. 
Cicourse project CCapstone project 
LIInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3, 5 & 8. 

The assessment coordinator / associate director conducted six senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes, (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to 
measure Learning Outcomes (see appendix), 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 





The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results, 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Learning Outcome #2 score: 4,8 out of 5 points. Goal achieved. 


The scale ratings included: 
5 — strongly agree 4— agree 3 — neutral 2 — disagree 1-— strongly disagree 


What do the results suggest about student achievement of this learning outcome? 
Students’ survey scores were 4.8/5, which indicates students strongly agreed and were satisfied in their learning and understanding 
of diversity issues in mass communications. Four students “strongly agreed” and one student “agreed” they had a good 


understanding of diversity issues, 


During the interview, all students agreed they felt confident in their understanding of diversity issues and all agreed they had 
discussed diversity in several SC classes, mainly regarding audiences. 


The School should continue to discuss diversity across its curriculum. 


Timeline for the Assessment 


ClEach Semester XlYearly O Every other year 


D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. In addition, strategic 
communications students are exposed to the history of advertising, public Relations and strategic communications in the 
Introduction to Strategic Communications course. Finally, an elective course in History of Mass Communications is consistently 


offered to students. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2,3,5&8. 

The assessment coordinator / associate director conducted five SC senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 


Learning Outcomes (see appendix). 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XiSurvey CO Comprehensive, certification, or LSatisfaction Survey 

ORating of skills (e.g., rubrics) professional exarn(s) Cl Benchmarking 

ClAnalysis of written artifacts OOral presentation CO Measuring effectiveness relative to 
O Course project professional standards 





OReview of thesis/dissertation/ creative Interviews COther (please specify): 


component (Performance or jury Click here to specify. 
OCapstone project Ovisual collection (photos, videos, etc.) 
OInternship OReview of student research 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Using a “graduating seniors” list provided by academic counselors, 10 SC names were randomly selected using 
www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 


then selected using the randomizer software. 


Did your department/program faculty have a goal set for this learning outcome? lYes ONo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 3. 
Learning Outcome #3 score: 4.4 out of 5 points, Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

Students’ survey scores were 4.4/5, which indicates students strongly agreed and were satisfied in their learning and understanding 
of the history and societal role of mass communications. Four students “strongly agreed” and one student “disagreed” they had a 
good understanding of the history and societal role of mass communications. 


During the interview, four of the five students agreed they felt confident in their understanding of mass communication’s history 
and role in society. One disagreed. 


The School is doing a good job of presenting and incorporating the history and societal role of mass communications in its curricula. 


Timeline for the Assessment 


ClEach Semester Yearly LlEvery other year 


D4) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 
concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 

The assessment coordinator / associate director conducted five senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 


Learning Outcomes (see appendix). 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


klSurvey C Satisfaction Survey Interviews 
C Rating of skills (e.g., rubrics) O Benchmarking CPerformance or jury 
DAnalysis of written artifacts O Measuring effectiveness relative to Olvisual collection (photos, videos, etc.) 
Licomprehensive, certification, or professional standards C Review of student research 
professional exam(s) OReview of thesis/dissertation/ creative COther (please specify): 
(CJOral presentation component Click here to specify, 
(Course project C1Capstone project 
OInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Using a “graduating seniors” list provided by academic counselors, 10 SC names were randomly selected using 
www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes, Five students were 
then selected using the randomizer software. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 4. 
Learning Outcome #5 score: 4.4 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

Four students agreed they learned basic mass media theoretical concepts in their classes, but they were less confident in this 
learning outcome as compared to other learning outcomes regarding their knowledge and/or application of theoretical 
concepts. One student was neutral. However, when asked specifically about theories and concepts used in strategic 
communications, three students were able to name and explain a few theories. 


The School should continue incorporating theoretical concepts of mass communications in its curricula. Each program’s faculty 
should meet once per semester to discuss curriculum in each class and what theories are taught in class. 


Timeline for the Assessment 


LlEach Semester KlYearly OEvery other year 


D5) Student Learning Outcome #8: Students will demonsirate an understanding of relevant planning and 
management methods in mass communication. 

Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 


communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 
Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 





The assessment coordinator / associate director conducted five senior exit interviews. 
First, they were asked to take a survey and rank their skills for learning outcomes. (see Appendix ). 
Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 


Learning Outcomes (see Appendix ). 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey O Satisfaction Survey Kinterviews 
C Rating of skills (e.g., rubrics) OBenchmarking OPerformance or jury 
Analysis of written artifacts O Measuring effectiveness relative to Ovisual collection (photos, videos, etc.) 
CComprehensive, certification, or professional standards OReview of student research 
professional exam(s) OReview of thesis/dissertation/ creative ClOther (please specify): 
OoOral presentation component Click here to specify. 
OCourse project C Capstone project 
(Internship 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Using a “graduating seniors” list provided by academic counselors, 10 SC names were randomly selected using 
www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 


then selected using the randomizer software. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 4. 
Learning Outcome #8 score: 4.4 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 
The majority of the students discussed the importance of learning about planning and media management. Four students 


indicated they developed a strong understanding of media planning and management through the Management and 
Strategies course, the Media Markets course, and the Capstone course, Campaigns; two mentioned the Advanced PR Writing 
course. The School is doing a good job of presenting and incorporating planning and management concepts and relevant 
assignments in its curricula. 


Timeline for the Assessment 


LlEach Semester Xl Yearly ClEvery other year 








Assessment Method #2: External Review of Graduating Senior Portfolios + Internship Supervisor Evaluations 


Learning Outcomes 4, 6 and 7 assessed 





D6) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as 
they relate to individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 


e MC 2003 - Media Style & Structure e SC 3463 -— Event Planning 

e MC 2023 - Electronic Reporting e SC 3953 — Research Methods 

e SC 3353 - Persuasive Writing e SC 4493 — Advanced PR Writing 
e SC 3363 — Graphic Design e SC 4843 -— Campaigns 


How many students were included in the assessment of this outcome? 
18: Internship assessment (10) and Portfolios assessment (8) 


How were students selected to participate in the assessment of this outcome? 

1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. Ten percent of the Spring 2017 
portfolio links were selected using the online randomizing tool, www.randomizer.com. Thus, of the 83 student portfolios 
received, 8 were selected for assessment for a total of 10 percent. 


2. Ten student internship evaluation forms were randomly selected (www.randomizer.com), which represented about 20 
percent of the internship evaluations. 


Assessment Methods 


CiSurvey OSatisfaction Survey OInterviews 

Xl Rating of skills (e.g., rubrics) Benchmarking Performance or jury 

(Analysis of written artifacts X Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
Comprehensive, certification, or professional standards O Review of student research 
professional exam(s) OReview of thesis/dissertation/ creative OOther (please specify): 

(Oral presentation component Click here to specify. 

Course project XI Capstone project 


internship 


Describe how the assessment method was implemented, administered, and/or conducted. 
In the portfolio assessment survey (see Appendix}, Learning Outcome #4 is assessed in four categories: 
1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 
3) if the student’s work reflected looking beyond the obvious (Excel Column F) 
4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 
*See Appendix For Excel Sheet / Results 
External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 





For the Internship Evaluation assessment survey (see Appendix), Learning Outcome #4 was assessed in one category: critical, 
creative and independent thinking. Internship Supervisors were asked to assess the student's work and rate the work on a 7- 
point-scale. 

= Not Applicable 

= Understanding Not Demonstrated 

= Demonstrated Only Slightly 

= Demonstrated Occasionally 

= Demonstrated But Needs Work 

= Demonstrated Well 

= Expertly Demonstrated 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 

External Reviewer Portfolio Assessment = the goal was to exceed 2016 scores, or better than a 4 out of 5. 

Internship assessment = the goal was to exceed 2016 scores, or better than a 4.6 out of 7. 

*New for 2017 — one SMSC professor was selected to evaluate portfolios. 

Provide a summary of the results from the assessment of Learning Outcome 4. 

External Reviewers - Portfolios - the mean score was a 3.66 / 5, which is lower than the 4 / 5 ranking in 2016. The goal was not met. 
Internship Assessment - the mean score was 6.7 /7, which is a significant improvement from last years’ score of 4.6. The score 
indicates students’ ability to think critically, creatively and independently. The goal was met. 


SMSC Professor - Portfolios — 3.9/5 


What do the results suggest about student achievement of this learning outcome? 

Portfolio score: The mean score for this learning outcome of demonstrating critical, creative and individual thinking was 3.66, 
which is lower than the previous year (4). The score indicates portfolios provided average representation of this learning 
outcome with room for improvement, Many of the professionals said there was not enough writing samples. Developing more 
writing assignments across curricula (that meet industry standards and best industry practices) and requiring more writing 
assignments be placed in the capstone portfolio is imperative. Furthermore, there needs to be more focus on helping students 
with portfolios in all upper-level classes. Faculty need to review student portfolios in each class to help students produce a 
professional portfolio. Capstone professors should review portfolios at the beginning and mid-semester to help students 
produce more professional work. 


SMSC changed the way it recruits external reviewers, which may be the cause for lower portfolio scores. In 2017, the 
Assessment Coordinator asked SMSC alumni who had at least three-to-five years’ experience working the communications 
field to review portfolios. In the past, SMSC used members of its Advisory Board to do the external portfolio reviews. 
However, many of the board members were no longer practicing professionals in the communications industry, which was 
cause for concern when they reviewed student work. Industry practices and technology change often and review of student 
work should reflect best industry practices. 


Internship Evaluation score: The mean score of 6.7 indicates students are working and thinking more independently than in 
past years. Several classes in SMSC’s curricula focus on critical thinking and creativity, and the evaluation results indicate the 
same. Students are prepared to think on their own and to think critically and creatively about audiences’ and clients’ needs. 
Timeline for the Assessment 


ClEach Semester XYearly L Every other year 


D7} Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques 


of research and information gathering 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students in Strategic Communication are required to take a course in Research Methods. All students are required to use 
research and data in their capstone project. They also need to have research skills to collect data for writing courses. 





How many students were included in the assessment of this outcome? 
18: Internship assessment (10) and Portfolios assessment (8) 


How were students selected to participate in the assessment of this outcome? 


1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. Ten percent of the Spring 2017 
portfolio links were selected using the online randomizing tool, www.randomizer.com. Thus, of the 83 student portfolios 
received, 8 were selected for assessment for a total of 10 percent. 





2. Ten student internship evaluation forms were randomly selected (www.randomizer.com), which represented about 20 
percent of the internship evaluations. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


CSurvey (Benchmarking C1Performance or jury 
Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
CAnalysis of written artifacts p Review of student research 
O Review of thesis/dissertation/ creative 


Ocomprehensive, certification, or OOther (please specify): 


: component 
professional exam(s) 


l CGapetore project Click here to specify, 
OoOral presentation 


? Internship 
Course project 


d i OiInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed evidence for 


1. the ability to gather information effectively and competently (Excel Column H) 
2. initiative and creativity in information gathering (Excel Column |) 

3. use multiple methods and sources for research (Excel Column J) 

4, to effectively communicate how the information was gathered (Excel Column K) 


*See Appendix For Excel Sheet / Results 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


In the Internship Assessment, supervisors provided an overall assessment of Learning Outcome #6 - an understanding of the 
methods and techniques used in research and information gathering. 
Internship Supervisors were asked to assess the student's work and rate the work on a 7-point-scale. 

= Not Applicable 

= Understanding Not Demonstrated 

= Demonstrated Only Slightly 

= Demonstrated Occasionally 

= Demonstrated But Needs Work 

= Demonstrated Well 

= Expertly Demonstrated 


1] 





Did your department/program faculty have a goal set for this learning outcome? lYes ONo 
Yes, to score better than 3.67 / 5 (2016 Portfolio score), and better than 5 /7 (2016 Internship Score) 


Provide a summary of the results from the assessment of Learning Outcome 6. 
Internship Assessment Score: The mean score was 6 /7, which is a significant improvement over 2016. Goal achieved. 
Portfolio Assessment Score: The mean score was 3.73, which is slightly higher than the 2016 score of 3.67. Goal achieved 


SMSC Professor Portfolio Score: 4/5 


What do the results suggest about student achievement of Learning Outcome 6? 

The score suggests students are slightly improving on their information gathering skills in internships and in class work, but there is 
still room for improvement. The faculty should find ways to incorporate more information gathering into class assignments, which 
will produce more writing samples. More writing samples give reviewers a better understanding of the students’ information 
gathering skills. Faculty should work with outside professionals to make sure best industry practices are learned in college courses. 


Timeline for the Assessment 


LlEach Semester Yearly CEvery other year 


D8) Student Learning Outcome #7; Students will demonstrate an understanding of the writing, editing and 
production techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 
18: Internship assessment (10) and Portfolios assessment (8) 


How were students selected to participate in the assessment of this outcome? 


1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. Ten percent of the Spring 2017 
portfolio links were selected using the online ra ndomizing tool, www.randomizer.com, Thus, of the 83 student portfolios 
received, 8 were selected for assessment for a total of 10 percent. 


2. Ten student internship evaluation forms were randomly selected (www.randomizer.com), which represented about 20 
percent of the internship evaluations. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


CSurvey C Benchmarking Performance or jury 

Rating of skills (e.g., rubrics) X Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
Analysis of written artifacts profesioa standard; O Review of student research 
OComprehensive, certification, or Eifieviewiot thesiefalssettatinny treagiua Cother (please specify): 


component 


professional exani(s) Click here to specify. 


EJ Capstone project 
COral presentation p Proj 


&XInternshi 
(1Course project R 


Ointerviews 
O Satisfaction Survey 
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Describe the how the assessment method was implemented, administered, and/or conducted. 
In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 


1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


*See Appendix For Excel Sheet / Results 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


In the Internship Assessment, supervisors provided an overall assessment of Learning Outcome #7 — student demonstrates an 


understanding of the writing, editing and production techniques of mass communication specialties 
Internship Supervisors were asked to assess the student’s work and rate the work on a 7-point-scale. 


Ts Not Applicable 
2= Understanding Not Demonstrated 
3= Demonstrated Only Slightly 
4= Demonstrated Occasionally 
gs Demonstrated But Needs Work 
6= Demonstrated Well 
7= Expertly Demonstrated 
Did your department/program faculty have a goal set for this learning outcome? Yes LINo 


Yes, to score better than in 2016. 


Provide a summary of the results from the assessment of Learning Outcome 7. 
Internship Assessment Score: The overall mean score was 6.70, which is significantly higher than the 2016 score of 4.5. Goal 


achieved. 


Portfolio Assessment Score: The mean score was 3.65, which is a decline from 2016’s score of 4.08. Goal not achieved. More writing 
samples are key to displaying students’ writing skills. 





SMSC Professor Portfolio Score: 4.2 





What do the results suggest about student achievement of this learning outcome? 

Students must add more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how 
to write effectively across multiple platforms. Faculty need to do more portfolio reviews and must meet with industry leaders to 
understand best industry practices and what skills are expected by industry professionals when students graduate. 


Timeline for the Assessment 


ClEach Semester xlYearly C Every other year 
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Senior Survey Sample 


Name: 





Circle one answer that reflects your level of achievement: 





Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and 
ethical principles involved in mass communication. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning Outcome 2: Students will demonstrate an understanding of the relevance of human diversity in mass 


communication. 
Strongly agree - 5 
Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree = 1 


Learning Outcome 3: Students will demonstrate respect for the history and social role of mass communications. 
Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning outcome 5: Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree -5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning outcome 8: Students will demonstrate an understanding of the relevant planning and management methods 
in mass communication. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 
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Senior Interview Questions 


1. Now that you’re about to graduate, what stands out most about your education in the past four years? 

2. Do you plan to work in your field of study? 

3. What subject matter / classes were the most difficult to learn in your major? How did you do in the class? 
Do you still remember what you learned? 

. What did you learn that you feel is most beneficial to you? Why? 

. Do you think diversity is important in your field of study? Why? 

. Do you think you learned a lot about the history of our profession? 

. Where do you think you will be in your career in five years? 

. What things would you have liked to learn that you didn’t? 

. Would you feel comfortable researching and planning an event or campaign? 

10. How do you feel about this accomplishment? 


oO ON DU eA 


Congratulations! You’re an alumnae or alumnus. 





Portfolio Assessment Survey 





ick to edit survey title | 


seal 


"Learning Outcomes Survey 


f 





Portfolio Assessment 


The purpose of this survey is to help us assess the quality of our program and students' ability to demonstrate learning outcomes. 
Please assess each of the learning outcomes based on the artifacts presented in the portfolios assigned to you. 


* 1. What is your name? 





rat 

















' Learning Outcomes Survey 





Learning Outcome 4 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 
Select the level of representation of the above learning outcome in the portfolio based on each of the following questions. 


* 3. The ability to analyze complex situations accurately. 
©) Noor poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
C) Average representation of learning outcome. 
C) Good representation of learning outcome. 


© Outstanding representation of learning outcome. 


* 4. The ability to craft innovative solutions to difficult problems. 
O No or poor representation of learning outcome. 
() Somewhat poor representation of learning outcome. 
© Average representation of learning outcome. 


QO Good representation of learning outcome. 


©) Outstanding representation of learning outcome. 


* 5, The ability to look beyond what is obvious and understand what lies beneath the surface. 
C) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
(O) Average representation of learning outcome. 
(O) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 6. The ability to effectively communicate complex ideas and make them understandable. 
©) No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
ia ) Average representation of learning outcome. 
©) Good representation of learning outcome. 


(©) Outstanding representation of learning outcome. 
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Learning Outcome 6 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 
Select the level of representation of the above learning outcome in the portfolio based on each of the following questions. 


* 7, Evidence of the ability to gather information effectively and completely. 
5 >) No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
(©) Average representation of learning outcome. 
©) Good representation of learning outcome. 


©) Outstanding representation of learning outcome. 


* 8, Evidence of initiative and creativity in information gathering. 
C) No or poor representation of learning outcome. 
(©) Somewhat poor representation of learning outcome. 
rN ‘ > 
(_) Average representation of learning outcome. 
C) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 9, The ability to use multiple methods and sources to research information. 
©) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
C) Average representation of learning outcome. 
C) Good representation of learning outcome. 


© Outstanding representation of learning outcome. 


* 10. The ability to effectively communicate how information was gathered. 
O No or poor representation of learning outcome. 
() Somewhat poor representation of learning outcome. 
©) Average representation of learning outcome. 
C) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 











' Learning Outcomes Survey 





Thank you 


We appreciate you sharing your time and expertise. 











External Reviewer Results for SC Portfolios 
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internship Supervisor Survey 


To what extent does the intern demonstrate the following 
characteristics? 


Not demonstrated 
Demonstrated 


1. An understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass 
communications. 


G 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts 
of mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 


Demonstrated 
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2016 - 2017 
Annual Assessment Report 


Bachelor of Arts 
Sports Media 





lazy. School of Media & Strategic Communication 


Sports Media — Bachelor of Arts 
Assessment Report Form 2016-2017 


UNIVERSITY 





Date of Report: 8/30/2017 


Name of Person Submitting Report: Gina J. Noble, Associate Director of Undergraduate Studies, School of Media 
& Strategic Communications 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator's Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2016-2017: 150 
Number of students graduated in 2016-2017: 35 


B. Program Mission Statement 


To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

O Critical thinking 


Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 


Feb ob ob a a 


Community involvement 


C. University Assessment Funds 


Were university assessment funds used by the department/program for assessment activities? KYes LINo 

Funds were used to pay SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working 
professionally at least three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s 
three programs). Funds were also used to pay one SMSC professor to assess the same portfolios. The funds helped legitimize the 
importance of SMSC’s assessment research to participating alumni because they took their jobs seriously and gave in-depth answers to 
help us better understand our students’ strengths and weaknesses, which helps faculty improve curricula. One-hundred percent of the 
selected participants completed the survey. 





D. Student Learning Outcomes 


NOTE...We have two degrees in sports media: a Bachelor of Science and a Bachelor of Arts. The only difference between the 


two is a foreign-language requirement in the Bachelor of Arts. 


NOTE...The following student learning outcomes are the same for each of the six degrees in the School of Media & Strategic 
Communication because of accreditation requirements set by our accrediting council — the Accrediting Council on Education in 
Journalism and Mass Communication http://www.acejme.or, licies-process/nine-standards 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 


communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass communication 


specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass communication. 





Assessment Method #1 — Graduating Senior Survey and Exit Interviews 





Learning Outcomes 1, 2, 3, 5, 8 











D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the core courses in Mass Communication Law and Media Ethics. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 
Using a “graduating seniors” list provided by academic counselors, 10 SPM names were randomly selected using www.randomizer.com. 
Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were then selected using the 


randomizer software. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XI Survey O Satisfaction Survey Interviews 
O Rating of skills (e.g., rubrics) Benchmarking OPerformance or jury 
O Analysis of written artifacts O Measuring effectiveness relative to DVisual collection (photos, videos, etc.) 
Comprehensive, certification, or professional standards C Review of student research 
professional exam(s) OReview of thesis/dissertation/ creative OOther (please specify): 
LOral presentation component 
[1Course project OCapstone project 
OInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3, 5 & 8. 

The assessment coordinator / associate director conducted five MMJ senior exit interviews. 

First, they were asked to take a survey for Learning Outcomes (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to 
measure Learning Outcomes (see appendix). 


Did your department/program faculty have a goal set for this learning outcome? KlYes CINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question on the senior exit survey, which would indicate that 
graduating seniors “agree” they understand and have an appreciation for the constitutional freedoms, legal issues and ethical 
considerations involved in mass communication. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 1. 
Learning Outcome #1 score: 4.4 out of 5 points. Goal achieved. 
The scale ratings included: 


5 — strongly agree 4-— agree 3 — neutral 2 — disagree 1- strongly disagree 


What do the results suggest about student achievement of this learning outcome? 





Results indicate students were satisfied with their knowledge of constitutional freedoms, legal issues and ethical principles in mass 
communication. Three students “strongly agreed” and two students “agreed” they had a good understanding of the First 
Amendment. One student said there should be more emphasis regarding ethics and law in other classes. 

During the interview, one student said he learned more in the Law class than in any other class, and all students recalled hearing 
about law and ethics in multiple classes. Three students said they were not comfortable discussing ethical principles and would not 
feel comfortable discussing ethical principles with professionals in the field. 


The School should continue to discuss constitutional freedoms and ethical considerations across its curriculum. 


D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the 
relevance of diversity in mass communications and the media. Also, the relevance of diversity is also covered in all of the Sports 
Media curriculum, including but not limited to Sports in the Media and Contemporary Sports Media. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Using a “graduating seniors” list provided by academic counselors, 10 SPM names were randomly selected using www.randomizer.com. 


Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were then selected using the 
randomizer software. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey LSatisfaction Survey linterviews 
C Rating of skills (e.g., rubrics) C)Benchmarking OPerformance or jury 
CAnalysis of written artifacts O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
Cicomprehensive, certification, or professional standards OReview of student research 
professional exam(s) CReview of thesis/dissertation/ creative Cother (please specify): 
ClOral presentation component Click here to specify. 
CCourse project OCapstone project 
OlInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3, 5 & 8. 

The assessment coordinator / associate director conducted six senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See Appendix) 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to 
measure Learning Outcomes (see Appendix). 


Did your department/program faculty have a goal set for this learning outcome? XlYes CINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Learning Outcome #2 score: 4.6 out of 5 points. Goal achieved. 





The scale ratings included: 
5 — strongly agree 4-agree 3 — neutral 2 — disagree 1-strongly disagree 


What do the results suggest about student achievement of this learning outcome? 

Students’ survey scores were 4.6/5, which indicates students strongly agreed and were satisfied in their learning and understanding 
of diversity issues in mass communications. Three students “strongly agreed” and two students “agreed” they had a good 
understanding of diversity issues. 


During the interview, all students agreed they felt confident in their understanding of diversity issues and all agreed they had 
discussed diversity in several classes in their major. 


The School should continue to discuss diversity across its curriculum. 


Timeline for the Assessment 


LlEach Semester KlYearly ClEvery other year 


D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. In addition, Sports Media 
students are exposed to the history of sports media in the Sports in the Media course. Finally, an elective course in History of 
Mass Communications is consistently offered to students. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3, 5 & 8. 
The assessment coordinator / associate director conducted five MMJ senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 


Learning Outcomes (see appendix). 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


kxlSurvey OSatisfaction Survey Interviews 

DRating of skills (e.g., rubrics) C Benchmarking (Performance or jury 

C Analysis of written artifacts CO Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
Ccomprehensive, certification, or professional standards CO Review of student research 
professional exam(s) O Review of thesis/dissertation/ creative ClOther (please specify): 

OOral presentation component Click here to specify. 

OCourse project CO Capstone project 


Clinternship 





Describe the how the assessment method was implemented, administered, and/or conducted. 
Using a “graduating seniors” list provided by academic counselors, 10 MMJ names were randomly selected using 
www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 


then selected using the randomizer software. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 3. 
Learning Outcome #3 score: 4.6 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

Students’ survey scores were 4.6/5, which indicates students strongly agreed and were satisfied in their learning and understanding 
of the history and societal role of mass communications. Three students “strongly agreed” and two students “agreed” they hada 
good understanding of the history and societal role of mass communications. 


The School is doing a good job of presenting and incorporating the history and societal role of mass communications in its curricula 
and should continue on this path. 


Timeline for the Assessment 


C Each Semester Yearly LlEvery other year 


D4) Student Learning Outcome #5; Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, Sports Media students are exposed to and asked to apply to the relevant theories and concepts of 
Sports Media through most of the courses in SPM, including the capstone course. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 

The assessment coordinator / associate director conducted five senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 
Learning Outcomes (See appendix). 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey C1Oral presentation CO Measuring effectiveness relative to 
ORating of skills (e.g., rubrics) C Course project professional standards 

DAnalysis of written artifacts USatisfaction Survey OReview of thesis/dissertation/ creative 
LComprehensive, certification, or O Benchmarking component 

professional exam(s) OCapstone project 





OInternship OVisual collection (photos, videos, etc.) Click here to specify. 


Interviews O)Review of student research 
CJPerformance or jury LOther (please specify): 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Using a “graduating seniors” list provided by academic counselors, 10 MMJ names were randomly selected using 


www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 


then selected using the randomizer. 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 5. 
Learning Outcome #5 score: 4.4 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

The students agreed they learned basic mass media theoretical concepts in their classes, but two students said they don’t 
recall discussing theories during any sports classes. Three said they were much less confident in this learning outcome as 
compared to other learning outcomes regarding their knowledge and/or application of theoretical concepts. One said more 


emphasis should be placed on theories in sports media. 


The School should continue incorporating theoretical concepts of mass communications in its curricula. Each program’s faculty 
(Sports Media, Strategic Communications and Multimedia Journalism) should meet once per semester to discuss curriculum in each 


class and what theories are taught in class. 
Timeline for the Assessment 


ClEach Semester lYearly ClEvery other year 


DS) Student Learning Outcome #8: Students will demonstrate an understanding of relevant planning and 
management methods in mass communication. 

Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically Sports Media: Sports PR, Contemporary Sports media, Sports Writing, Data Journalism and 
all of the production courses. 


How many students were included in the assessment of this outcome? 


5 


How were students selected to participate in the assessment of this outcome? 
Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 
The assessment coordinator / associate director conducted five senior exit interviews. 
First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 
Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 


Learning Outcomes (See appendix). 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OSatisfaction Survey Interviews 
ORating of skills (e.g., rubrics) C1Benchmarking [Performance or jury 
DAnalysis of written artifacts O Measuring effectiveness relative to Ovisual collection (photos, videos, etc.) 
Cicomprehensive, certification, or professional standards OReview of student research 
professional exam(s) OReview of thesis/dissertation/ creative COther (please specify): 
COral presentation component Click here to specify. 
CCourse project OCapstone project 
CiInternship 


Describe the how the assessment method was implemented, administered, and/or conducted, 
Using a “graduating seniors” list provided by academic counselors, 10 MMJ names were randomly selected using 


www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 
then selected using the randomizer software 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey. 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Learning Outcome #8 score: 4.4 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

Two of the students interviewed indicated they were much better at planning and understood more about management 
methods than when they started the major, but both students said there could be more management classes to help those 
who want to manage media. One students said planning wasn’t highlighted in most of the classes. 


Timeline for the Assessment 


ClEach Semester lYearly CEvery other year 








Assessment Method #2: External Review of Graduating Senior Portfolios + Internship Supervisor Evaluations 
Learning Outcomes 4, 6 and 7 assessed 








D6) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as 
they relate to individual disciplines in mass communication. 
Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing, reporting and production courses to critically assess information before presenting in the form of written or electronic 


artifacts. 


How many students were included in the assessment of this outcome? 
10: Internship assessment (5) and Portfolio assessment (5) 





How were students selected to participate in the assessment of this outcome? 

1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. 29 student portfolios were 
received in Spring 2017. Portfolio links were selected using the online randomizing tool, www.randomizer.com, Of the 29 
student portfolios received, 5 were selected for assessment, or 17 percent. 


2. Five student internship evaluation forms were randomly selected from a total of 19 sport media internship evaluations 
(www.randomizer.com), which represented 26 percent of the internship evaluations. 


Assessment Methods 


(Survey OSatisfaction Survey Uiinterviews 

Rating of skills (e.g., rubrics) O Benchmarking OPerformance or jury 

DAnalysis of written artifacts Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
CComprehensive, certification, or professional standards ClReview of student research 
professional exam(s) OReview of thesis/dissertation/ creative OOther (please specify): 

OOral presentation component Click here to specify. 

(Course project XI] Capstone project 


Internship 
Describe how the assessment method was implemented, administered, and/or conducted. 


In the portfolio assessment survey (see Appendix), Learning Outcome #4 is assessed in four categories: 

1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 

2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 

*See Appendix For Excel Sheet / Results 
External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


For the Internship Evaluation assessment survey (see Appendix), Learning Outcome #4 was assessed in one category: critical, 
creative and independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a 7- 


point-scale. 
i= Not Applicable 
De Understanding Not Demonstrated 
a Demonstrated Only Slightly 
4= Demonstrated Occasionally 
5s Demonstrated But Needs Work 
6= Demonstrated Well 
7= Expertly Demonstrated 
Did your department/program faculty have a goal set for this learning outcome? Yes ONo 


External Reviewer Portfolio Assessment = the goal was to exceed 2016 scores, or better than a 4.25 out of 5, 
Internship assessment = the goal was to exceed 2016 scores, or better than a 4.8 out of 7. 
*New for 2017 — one SMSC professor was selected to evaluate portfolios. 





Provide a summary of the results from the assessment of Learning Outcome 4. 
External Reviewers for Portfolios - the mean score was a 3.5 / 5, which is lower than the 4.25 / 5 score in 2016. The goal was not met. 
SMSC Professor / Portfolios: 3.75 


Internship Assessment - the mean score was 5.8 / 7, which is a significant improvement from last years’ score of 4.8. The goal was 
met. 





What do the results suggest about student achievement of this learning outcome? 

Portfolio score: The score indicates portfolios provided average representation of this learning outcome with room for 
improvement. Reviewers said there was not enough writing samples. Developing more writing assignments across curricula 
(that meet industry standards and best industry practices) and requiring more writing assignments be placed in the capstone 
portfolio is imperative. Furthermore, there needs to be more focus on helping students with portfolios in all upper-level 
classes. Faculty need to review student portfolios in each class to help students produce a professional portfolio. Capstone 
professors should review portfolios at the beginning and mid-semester to help students produce more professional work. 


SMSC changed the way it recruits external reviewers, which may be the cause for lower portfolio scores. In 2017, the 
Assessment Coordinator asked SMSC alumni who had at least three-to-five years’ experience working the communications 
field to review portfolios. In the past, SMSC used members of its Advisory Board to do the external portfolio reviews. 
However, many of the board members were no longer practicing professionals in the communications industry, which was 
cause for concern when they reviewed student work. Industry practices and technology change often and review of student 


work should reflect best industry practices. 


Internship Evaluation score: The mean score indicates students are working and thinking more independently than in past 
years. Several classes in SMSC’s curricula focus on critical thinking and creativity, and the evaluation results indicate the same. 
Students are prepared to think on their own to solve problems associated with MMJ, such as gathering information, finding 


sources, conducting interviews, writing, etc. 
Timeline for the Assessment 


ClEach Semester Yearly ClEvery other year 


D7) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques 
of research and information gathering. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students in Sports Media are incorporate information gathering and sports data analysis in their writing courses. All students 
are required to use data in their capstone project. 


How many students were included in the assessment of this outcome? 
10: Internship assessment (5) and Portfolio assessment (5) 


How were students selected to participate in the assessment of this outcome? 


1, Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. 29 student portfolios were 
received in Spring 2017. Portfolio links were selected using the online randomizing tool, www.randomizer.com, Of the 29 
student portfolios received, 5 were selected for assessment, or 17 percent. 


2. Five student internship evaluation forms were randomly selected from a total of 19 sport media internship evaluations 
(www.randomizer.com), which represented 26 percent of the internship evaluations. 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey Benchmarking C Performance or jury 
Rating of skills (e.g., rubrics) Xl Measuring effectiveness relative to XVisual collection (photos, videos, etc.) 
rofessional standards 
LAnalysis of written artifacts p Review of student research 
OReview of thesis/dissertation/ creative 


CComprehensive, certification, or component COther (please specify): 


professional exam(s) . Click here to specify. 
, O Capstone project 
OOral presentation 


Kinternshi 
LCourse project p 


f : OInterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 


In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed evidence for 

1. the ability to gather information effectively and competently (Excel Column H) 

2. initiative and creativity in information gathering (Excel Column 1) 

3. use multiple methods and sources for research (Excel Column J) 

4. to effectively communicate how the information was gathered (Excel Column K) 

“Spe Appendix For Excel Sheet / Results 

External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an 
online survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


In the Internship Assessment, supervisors provided an overall assessment of Learning Outcome #6 - an understanding of the 
methods and techniques used in research and information gathering. Internship Supervisors were asked to assess the 
student’s work and rate the work on a 7-point-scale, 
1. Not Applicable 2 
Understanding Not Demonstrated 
Demonstrated Only Slightly 
Demonstrated Occasionally 
Demonstrated But Needs Work 
Demonstrated Well 
Expertly Demonstrated 


SEUS MAUPUN 


Did your department/program faculty have a goal set for this learning outcome? KYes CINo 
Yes, to score better than 4.4 / 5 (2016 Portfolio score), and better than 4.5 /7 (2016 Internship Score) 
*New for 2017 — one SMSC professor was selected to evaluate portfolios. 


Provide a summary of the results from the assessment of Learning Outcome 6. 


Internship Assessment Score: The mean score was 5.4/ 7, which is a significant improvement over 2016. Goal achieved. 
Portfolio Assessment Score: The mean score was 3.77, which is lower than the 2016 score of 4.4 Goal not achieved. 


SMSC Professor — Portfolios: 3.9 


What do the results suggest about student achievement of Learning Outcome 6? 


1] 





The score suggests students are slightly improving on their information gathering skills in internships and in class work, but there is 
still room for improvement. The portfolio score may be lower because of the switch in external reviewers from Advisory Board 
members to professionals working in the field. The faculty should find ways to incorporate more information gathering into class 
assignments, which will produce more writing samples. More writing samples give reviewers a better understanding of the students’ 
information gathering skills. Faculty should work with outside professionals to make sure best industry practices are learned in 
college courses. 


Timeline for the Assessment 


ClEach Semester XlYearly C Every other year 


D8) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and 
production techniques of mass communication specialties, 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program. Sports Strategic Communication majors include: Persuasive Writing and Sports PR. Sports 
Journalism majors include: Reporting, Electronic Sports Reporting, Editing, Data Journalism and Sports Writing. Sports 
production majors include: Reporting, Electronic Sports Reporting, and editing in production courses. In addition, Sports Media 
students are expected to show these skills in their capstone course. 


How many students were included in the assessment of this outcome? 
10: Internship assessment (5) and Portfolio assessment (5) 


How were students selected to participate in the assessment of this outcome? 


1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. 29 student portfolios were 
received in Spring 2017. Portfolio links were selected using the online randomizing tool, www.randomizer.com. Of the 29 
student portfolios received, 5 were selected for assessment, or 17 percent. 


2. Five student internship evaluation forms were randomly selected from a total of 19 sport media internship evaluations 
(www.randomizer.com), which represented 26 percent of the internship evaluations. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


C1Survey O Benchmarking OPerformance or jury 
Rating of skills (e.g., rubrics) X Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p OReview of student research 
C Review of thesis/dissertation/ creative 


COComprehensive, certification, or LlOther (please specify): 


s component 
professional exam(s) 


Cli t ify. 
l BaCapstone project ick here to specify 
Coral presentation 

X Internshi 
[Course project p 


a, CInterviews 
DSatisfaction Survey 
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Describe the how the assessment method was implemented, administered, and/or conducted. 
In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 


1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


*See Appendix For Excel Sheet / Results 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


In the Internship Assessment, supervisors provided an overall assessment of Learning Outcome #7 — student demonstrates an 
understanding of the writing, editing and production techniques of mass communication specialties 
Internship Supervisors were asked to assess the student's work and rate the work on a 7-point-scale. 

= Not Applicable 

= Understanding Not Demonstrated 

= Demonstrated Only Slightly 

= Demonstrated Occasionally 

= Demonstrated But Needs Work 

= Demonstrated Well 

= Expertly Demonstrated 


Did your department/program faculty have a goal set for this learning outcome? KlYes ONo 
Yes, to score better than in 2016 — Internship Evaluations (5.2/7) / Portfolios (4.2/5) 
*New for 2017 — one SMSC professor was selected to evaluate portfolios. 


Provide a summary of the results from the assessment of Learning Outcome 7. 
Internship Assessment Score: The overall mean score was 5.8, which is slightly higher than the 2016 score of 5.2. Goal achieved. 


Portfolio Assessment Score: The mean score was 3.65, which is lower than in 2016. Goal not achieved. Faculty need to review 
portfolios in all classes, and more writing samples across different platforms need to be added to student portfolios. 


SMSC Professor Portfolio Score: 3.8 





What do the results suggest about student achievement of this learning outcome? 

Students must add more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how 
to write effectively across multiple platforms. Faculty need to do more portfolio reviews and must meet with industry leaders to 
understand best industry practices and what skills are expected by industry professionals when students graduate. 


Timeline for the Assessment 


O Each Semester Yearly LlEvery other year 
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15: Senior Exit Survey Sample 

16. Senior Interview questions 

17. Portfolio Assessment survey 

22. Portfolio Assessment Results — Excel Sheet 
23. Internship Evaluations by Supervisor 
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Senior Survey 


Name: 
Circle one answer that reflects your level of achievement: 


Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and 
ethical principles involved in mass communication. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning Outcome 2: Students will demonstrate an understanding of the relevance of human diversity in mass 
communication. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning Outcome 3: Students will demonstrate respect for the history and social role of mass communications. 
Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning outcome 5: Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning outcome 8: Students will demonstrate an understanding of the relevant planning and management methods 
in mass communication. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 





Senior Interview Questions 


1. Now that you’re about to graduate, what stands out most about your education in the past four years? 

2. Do you plan to work in your field of study? 

3. What subject matter / classes were the most difficult to learn in your major? How did you do in the class? 
Do you still remember what you learned? 

4. What did you learn that you feel is most beneficial to you? Why? 

5. Do you think diversity is important in your field of study? Why? 

6. Do you think you learned a lot about the history of our profession? 

7. Where do you think you will be in your career in five years? 

8. What things would you have liked to learn that you didn’t? 

9. Would you feel comfortable researching and planning an event or campaign? 

10. How do you feel about this accomplishment? 


Congratulations! You’re an alumnae or alumnus. 





Portfolio Assessment Survey 





Portfolio Assessment 


The purpose of this survey is to help us assess the quality of our program and students’ ability to demonstrate learning outcomes. 
Please assess each of the learning outcomes based on the artifacts presented in the portfolios assigned to you. 


* 1. What is your name? 








2. What is name of the student whose portfolio you are analyzing? 























-A Learning Outcomes Survey 





Learning Outcome 4 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions. 


* 3, The ability to analyze complex situations accurately. 
() No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
J Average representation of learning outcome. 
(O Good representation of learning outcome. 


© Outstanding representation of learning outcome. 


* 4. The ability to craft innovative solutions to difficult problems. 
C) No or poor representation of learning outcome. 
(O Somewhat poor representation of learning outcome. 
() Average representation of learning outcome. 
C) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 5, The ability to look beyond what is obvious and understand what lies beneath the surface. 
Cy No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
(C) Average representation of learning outcome. 
C) Good representation of learning outcome. 


=. Outstanding representation of learning outcome. 


* 6. The ability to effectively communicate complex ideas and make them understandable. 
C) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
(O Average representation of learning outcome. 
©) Good representation of learning outcome. 


(_) Outstanding representation of learning outcome, 














Learning Outcome 6 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 
Select the level of representation of the above learning outcome in the portfolio based on each of the following questions. 


* 7, Evidence of the ability to gather information effectively and completely. 
©) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
©) Average representation of learning outcome. 
©) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 8. Evidence of initiative and creativity in information gathering. 
©) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
©) Average representation of learning outcome. 
C) Good representation of learning outcome. 


() Outstanding representation of learning outcome. 


* 9. The ability to use multiple methods and sources to research information. 
©) No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
(C) Average representation of learning outcome. 
C) Good representation of learning outcome. 


©) Outstanding representation of learning outcome. 


*10. The ability to effectively communicate how information was gathered. 
C) No or poor representation of learning outcome. 


C) Somewhat poor representation of learning outcome. 


la 


() Average representation of learning outcome. 
©) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 











Thank you 


We appreciate you sharing your time and expertise. 














External Reviewer Results - Portfolios 
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Column P question for reviewers: Is the portfolio professional and will it help the student find employment after graduation? 
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Internship Supervisor Survey 


To what extent does the intern demonstrate the following 
characteristics? 


Not applicable 

Demonstrated only slightly 
Demonstrated occasionally 
Demonstrated but needs work 
Demonstrated well 

Expertly demonstrated 


E 


1. An understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass 
communications. 





2. An understanding of the relevance of human diversity in 
mass communications. 





3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5, An understanding of the relevant theories and concepts 
of mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in 
mass communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 
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2016 - 2017 
Annual Assessment Report 


Bachelor of Science 
Sports Media 





OKLAHOMA School of Media & Strategic Communication 
Sports Media — Bachelor of Science 
Assessment Report Form 2016-2017 


UNIVERSITY. 





Date of Report: 8/30/2017 


Name of Person Submitting Report: Gina J. Noble, Associate Director of Undergraduate Studies, School of Media 
& Strategic Communications 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator's Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2016-2017: 150 
Number of students graduated in 2016-2017: 35 


B. Program Mission Statement 


To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

O Critical thinking 


Creativity 


Global awareness 


j Gs 


Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 


(he eh ey 


Community involvement 


C. University Assessment Funds 


Were university assessment funds used by the department/program for assessment activities? XYes ONo 

Funds were used to pay SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working 
professionally at least three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s 
three programs). Funds were also used to pay one SMSC professor to assess the same portfolios. The funds helped legitimize the 
importance of SMSC’s assessment research to participating alumni because they took their jobs seriously and gave in-depth answers to 
help us better understand our students’ strengths and weaknesses, which helps faculty improve curricula. One-hundred percent of the 
selected participants completed the survey. 





D. Student Learning Outcomes 


NOTE...We have two degrees in sports media: a Bachelor of Science and a Bachelor of Arts. The only difference between the 


two is a foreign-language requirement in the Bachelor of Arts. 


NOTE...The following student learning outcomes are the same for each of the six degrees in the School of Media & Strategic 
Communication because of accreditation requirements set by our accrediting council — the Accrediting Council on Education in 


Journalism and Mass Communication http://www.acejmc.org/policies-process/nine-standards/ 


The following student learning outcomes were assessed: 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 


communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass communication 
specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass communication. 

















Assessment Method #1 — Graduating Senior Survey and Exit Interviews 





Learning Outcomes 1, 2, 3, 5, 8 


D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the core courses in Mass Communication Law and Media Ethics. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 
Using a “graduating seniors” list provided by academic counselors, 10 SPM names were randomly selected using www.randomizer.com. 
Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were then selected using the 


randomizer software. 


Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey DSatisfaction Survey XlInterviews 
ORating of skills (e.g., rubrics) C1Benchmarking CPerformance or jury 
LAnalysis of written artifacts O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
[1Ccomprehensive, certification, or professional standards OReview of student research 
professional exam(s) C Review of thesis/dissertation/ creative OOther (please specify): 
L1Oral presentation component 
OCourse project DCapstone project 
CInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 

The assessment coordinator / associate director conducted five MMJ senior exit interviews. 

First, they were asked to take a survey for Learning Outcomes (See appendix), 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to 
measure Learning Outcomes (see appendix). 


Did your department/program faculty have a goal set for this learning outcome? XlYes CINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question on the senior exit survey, which would indicate that 
graduating seniors “agree” they understand and have an appreciation for the constitutional freedoms, legal issues and ethical 
considerations involved in mass communication. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 1. 


Learning Outcome #1 score: 4.4 out of 5 points. Goal achieved. 
The scale ratings included: 
5-— strongly agree 4-— agree 3 — neutral 2 — disagree 1- strongly disagree 


What do the results suggest about student achievement of this learning outcome? 

Results indicate students were satisfied with their knowledge of constitutional freedoms, legal issues and ethical principles in mass 
communication. Three students “strongly agreed” and two students “agreed” they had a good understanding of the First 
Amendment. One student said there should be more emphasis regarding ethics and law in other classes. 





During the interview, one student said he learned more in the Law class than in any other class, and all students recalled hearing 
about law and ethics in multiple classes. Three students said they were not comfortable discussing ethical principles and would not 
feel comfortable discussing ethical principles with professionals in the field. 


The School should continue to discuss constitutional freedoms and ethical considerations across its curriculum. 


D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the 
relevance of diversity in mass communications and the media. Also, the relevance of diversity is also covered in all of the Sports 
Media curriculum, including but not limited to Sports in the Media and Contemporary Sports Media. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Using a “graduating seniors” list provided by academic counselors, 10 SPM names were randomly selected using www.randomizer.com. 
Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were then selected using the 
randomizer software. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey OSatisfaction Survey XlInterviews 
ORating of skills (e.g., rubrics) Benchmarking OPerformance or jury 
CAnalysis of written artifacts O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
Ccomprehensive, certification, or professional standards O Review of student research 
professional exam(s) OReview of thesis/dissertation/ creative Other (please specify): 
COral presentation component Click here to specify. 
OCourse project OCapstone project 
Olnternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3, 5 & 8. 

The assessment coordinator / associate director conducted six senior exit interviews, 

First, they were asked to take a survey and rank their skills for learning outcomes. (See Appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to 
measure Learning Outcomes (see Appencdix). 


Did your department/program faculty have a goal set for this learning outcome? lYes ONo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 2. 

Learning Outcome #2 score: 4.6 out of 5 points. Goal achieved. 

The scale ratings included: 

5- strongly agree 4-—agree 3 — neutral 2 — disagree 1-strongly disagree 





What do the results suggest about student achievement of this learning outcome? 

Students’ survey scores were 4.6/5, which indicates students strongly agreed and were satisfied in their learning and understanding 
of diversity issues in mass communications. Three students “strongly agreed” and two students “agreed” they had a good 
understanding of diversity issues. 


During the interview, all students agreed they felt confident in their understanding of diversity issues and all agreed they had 
discussed diversity in several classes in their major. 


The School should continue to discuss diversity across its curriculum. 
Timeline for the Assessment 


ClEach Semester Yearly C Every other year 


D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the following core courses; Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. In addition, Sports Media 
students are exposed to the history of sports media in the Sports in the Media course. Finally, an elective course in History of 
Mass Communications is consistently offered to students. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 

The assessment coordinator / associate director conducted five MMJ senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 
Learning Outcomes (see appendix). 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey O Satisfaction Survey interviews 
CRating of skills (e.g., rubrics) [Benchmarking (Performance or jury 
CAnalysis of written artifacts O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
CLicomprehensive, certification, or professional standards O Review of student research 
professional exam(s) C Review of thesis/dissertation/ creative (Other (please specify): 
OOral presentation component Click here to specify. 
LCourse project CCapstone project 
OInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 





Using a “graduating seniors” list provided by academic counselors, 10 MMJ names were randomly selected using 
www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 
then selected using the randomizer software. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 3. 
Learning Outcome #3 score: 4.6 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

Students’ survey scores were 4.6/5, which indicates students strongly agreed and were satisfied in their learning and understanding 
of the history and societal role of mass communications. Three students “strongly agreed” and two students “agreed” they had a 
good understanding of the history and societal role of mass communications. 


The School is doing a good job of presenting and incorporating the history and societal role of mass communications in its curricula 
and should continue on this path. 


Timeline for the Assessment 


LlEach Semester XlYearly CEvery other year 


D4) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 
concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, Sports Media students are exposed to and asked to apply to the relevant theories and concepts of 
Sports Media through most of the courses in SPM, including the capstone course. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 

Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3, 5 & 8. 

The assessment coordinator / associate director conducted five senior exit interviews. 

First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 

Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 
Learning Outcomes (See appendix). 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey (1Course project OReview of thesis/dissertation/ creative 
CRating of skills (e.g., rubrics) Satisfaction Survey component 

OAnalysis of written artifacts CL) Benchmarking COCapstone project 

Clcomprehensive, certification, or O Measuring effectiveness relative to OlInternship 

professional exam(s) professional standards XlInterviews 

COral presentation C)Performance or jury 





OVisual collection (photos, videos, etc.) COther (please specify): 
CiReview of student research Click here to specify. 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Using a “graduating seniors” list provided by academic counselors, 10 MMJ names were randomly selected using 


www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 


then selected using the randomizer. 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. This was the first year to specify a goal, and the goal was based on 2016 results. 


Provide a summary of the results from the assessment of Learning Outcome 5. 
Learning Outcome #5 score: 4.4 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

The students agreed they learned basic mass media theoretical concepts in their classes, but two students said they don’t 
recall discussing theories during any sports classes. Three said they were much less confident in this learning outcome as 
compared to other learning outcomes regarding their knowledge and/or application of theoretical concepts. One said more 
emphasis should be placed on theories in sports media. 


The School should continue incorporating theoretical concepts of mass communications in its curricula. Each program’s faculty 
(Sports Media, Strategic Communications and Multimedia Journalism) should meet once per semester to discuss curriculum in each 


class and what theories are taught in class. 
Timeline for the Assessment 


LEach Semester KYearly O Every other year 


D5) Student Learning Outcome #8: Students will demonstrate an understanding of relevant planning and 
management methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically Sports Media: Sports PR, Contemporary Sports media, Sports Writing, Data Journalism and 


all of the production courses. 


How many students were included in the assessment of this outcome? 


5 


How were students selected to participate in the assessment of this outcome? 
Surveys and interviews were conducted with graduating seniors, which measured Learning Outcomes 1, 2, 3,5 & 8. 
The assessment coordinator / associate director conducted five senior exit interviews. 
First, they were asked to take a survey and rank their skills for learning outcomes. (See appendix). 
Next, they were asked to talk about their learning experiences in the major — questions were embedded in the conversation to measure 


Learning Outcomes (See appendix). 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey LSatisfaction Survey Xlinterviews 
ORating of skills (e.g., rubrics) (Benchmarking (Performance or jury 
C Analysis of written artifacts O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
Cicomprehensive, certification, or professional standards CReview of student research 
professional exam(s) O Review of thesis/dissertation/ creative Clother (please specify): 
C1Oral presentation component Click here to specify. 
OCourse project CCapstone project 
OInternship 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Using a “graduating seniors” list provided by academic counselors, 10 MMJ names were randomly selected using 


www.randomizer.com. Each student was emailed and ask to participate in a senior exit interview; all said yes. Five students were 
then selected using the randomizer software 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey. 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Learning Outcome #8 score: 4.4 out of 5 points. Goal achieved. 


What do the results suggest about student achievement of this learning outcome? 

Two of the students interviewed indicated they were much better at planning and understood more about management 
methods than when they started the major, but both students said there could be more management classes to help those 
who want to manage media. One students said planning wasn’t highlighted in most of the classes. 


Timeline for the Assessment 


ClEach Semester klYearly CEvery other year 








Assessment Method #2: External Review of Graduating Senior Portfolios + Internship Supervisor E valuations 
Learning Outcomes 4, 6 and 7 assessed 





D6) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as 
they relate to individual disciplines in mass communication. 
Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing, reporting and production courses to critically assess information before presenting in the form of written or electronic 


artifacts. 


How many students were included in the assessment of this outcome? 
10: Internship assessment (5) and Portfolio assessment (5) 





How were students selected to participate in the assessment of this outcome? 

1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. 29 student portfolios were 
received in Spring 2017. Portfolio links were selected using the online randomizing tool, www.randomizer.com. Of the 29 
student portfolios received, 5 were selected for assessment, or 17 percent. 


2. Five student internship evaluation forms were randomly selected from a total of 19 sport media internship evaluations 
(www.randomizer.com), which represented 26 percent of the internship evaluations. 


Assessment Methods 


[Survey OSatisfaction Survey Cinterviews 

Xl Rating of skills (e.g., rubrics) C1 Benchmarking ClPerformance or jury 

DAnalysis of written artifacts Xl Measuring effectiveness relative to EJ) Visual collection (photos, videos, etc.) 
Lcomprehensive, certification, or professional standards Review of student research 
professional exam(s) O Review of thesis/dissertation/ creative OOther (please specify): 

ClOral presentation component Click here to specify. 

CCourse project Kl Capstone project 


Internship 
Describe how the assessment method was implemented, administered, and/or conducted. 


In the portfolio assessment survey (sce Appendix), Learning Outcome #4 is assessed in four categories: 

1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 

2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 

*See Appendix For Excel Sheet / Results 
External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


For the Internship Evaluation assessment survey (see Appencix), Learning Outcome #4 was assessed in one category: critical, 
creative and independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a 7- 
point-scale. 

s Not Applicable 

= Understanding Not Demonstrated 

= Demonstrated Only Slightly 

s Demonstrated Occasionally 

= Demonstrated But Needs Work 

= Demonstrated Well 

= Expertly Demonstrated 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
External Reviewer Portfolio Assessment = the goal was to exceed 2016 scores, or better than a 4.25 out of 5. 
Internship assessment = the goal was to exceed 2016 scores, or better than a 4.8 out of 7. 

*New for 2017 — one SMSC professor was selected to evaluate portfolios, 








Provide a summary of the results from the assessment of Learning Outcome 4. 

External Reviewers for Portfolios - the mean score was a 3.5 / 5, which is lower than the 4,25 / 5 score in 2016. The goal was not met. 
SMSC Professor / Portfolios: 3.75 

Internship Assessment - the mean score was 5.8 / 7, which is a significant improvement from last years’ score of 4.8. The goal was 


met. 


What do the results suggest about student achievement of this learning outcome? 

Portfolio score: The score indicates portfolios provided average representation of this learning outcome with room for 
improvement. Reviewers said there was not enough writing samples. Developing more writing assignments across curricula 
(that meet industry standards and best industry practices) and requiring more writing assignments be placed in the capstone 
portfolio is imperative. Furthermore, there needs to be more focus on helping students with portfolios in all upper-level 
classes. Faculty need to review student portfolios in each class to help students produce a professional portfolio. Capstone 
professors should review portfolios at the beginning and mid-semester to help students produce more professional work. 


SMSC changed the way it recruits external reviewers, which may be the cause for lower portfolio scores. In 2017, the 
Assessment Coordinator asked SMSC alumni who had at least three-to-five years’ experience working the communications 
field to review portfolios. In the past, SMSC used members of its Advisory Board to do the external portfolio reviews. 
However, many of the board members were no longer practicing professionals in the communications industry, which was 
cause for concern when they reviewed student work. Industry practices and technology change often and review of student 


work should reflect best industry practices. 


Internship Evaluation score: The mean score indicates students are working and thinking more independently than in past 
years. Several classes in SMSC’s curricula focus on critical thinking and creativity, and the evaluation results indicate the same. 
Students are prepared to think on their own to solve problems associated with MMJ, such as gathering information, finding 


sources, conducting interviews, writing, etc. 
Timeline for the Assessment 


C Each Semester Yearly CEvery other year 


D7) Student Learning Outcome #6; Students will demonstrate an understanding of the methods and techniques 
of research and information gathering 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students in Sports Media are incorporate information gathering and sports data analysis in their writing courses. All students 
are required to use data in their capstone project. 


How many students were included in the assessment of this outcome? 
10: Internship assessment (5) and Portfolio assessment (5) 


How were students selected to participate in the assessment of this outcome? 


1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. 29 student portfolios were 
received in Spring 2017. Portfolio links were selected using the online randomizing tool, www.randomizer.com. Of the 29 
student portfolios received, 5 were selected for assessment, or 17 percent, 


2. Five student internship evaluation forms were randomly selected from a total of 19 sport media internship evaluations 
(www.randomizer.com), which represented 26 percent of the internship evaluations. 
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Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


(Survey C Benchmarking O Performance or jury 
XRating of skills (e.g., rubrics) Measuring effectiveness relative to MVisual collection (photos, videos, etc.) 
rofessional standards 
CAnalysis of written artifacts p Review of student research 
O Review of thesis/dissertation/ creative 


Licomprehensive, certification, or component Clother (please specify): 


professional exam(s) Click here to specify 
P C Capstone project : 
OoOral presentation 
Internshi 
CCourse project p 
7 À Olnterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 


In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed evidence for 

1, the ability to gather information effectively and competently (Excel Column H) 

2. initiative and creativity in information gathering (Excel Column 1) 

3. use multiple methods and sources for research (Excel Column J) 

4. to effectively communicate how the information was gathered (Excel Column K) 

*See Appendix For Excel Sheet / Results 

External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an 

online survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


In the Internship Assessment, supervisors provided an overall assessment of Learning Outcome #6 - an understanding of the 
methods and techniques used in research and information gathering. Internship Supervisors were asked to assess the 
student's work and rate the work on a 7-point-scale. 
i Not Applicable 2 
Understanding Not Demonstrated 
Demonstrated Only Slightly 
Demonstrated Occasionally 
Demonstrated But Needs Work 
Demonstrated Well 
Expertly Demonstrated 


NQURWHN 


Did your department/program faculty have a goal set for this learning outcome? xlYes CINo 
Yes, to score better than 4.4 / 5 (2016 Portfolio score), and better than 4.5 /7 (2016 Internship Score) 
*New for 2017 — one SMSC professor was selected to evaluate portfolios. 


Provide a summary of the results from the assessment of Learning Outcome 6. 
Internship Assessment Score: The mean score was 5,4/7, which is a significant improvement over 2016. Goal achieved, 
Portfolio Assessment Score: The mean score was 3.77, which is lower than the 2016 score of 4.4 Goal not achieved. 


SMSC Professor — Portfolios: 3.9 
What do the results suggest about student achievement of Learning Outcome 6? 
The score suggests students are slightly improving on their information gathering skills in internships and in class work, but there is 
still room for improvement. The portfolio score may be lower because of the switch in external reviewers from Advisory Board 
1] 





members to professionals working in the field. The faculty should find ways to incorporate more information gathering into class 
assignments, which will produce more writing samples. More writing samples give reviewers a better understanding of the students’ 
information gathering skills. Faculty should work with outside professionals to make sure best industry practices are learned in 
college courses. 


Timeline for the Assessment 


ClEach Semester Xl Yearly ClEvery other year 


D8) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and 
production techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2016-2017 academic year: 


All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program. Sports Strategic Communication majors include: Persuasive Writing and Sports PR. Sports 
Journalism majors include: Reporting, Electronic Sports Reporting, Editing, Data Journalism and Sports Writing. Sports 
production majors include: Reporting, Electronic Sports Reporting, and editing in production courses, In addition, Sports Media 
students are expected to show these skills in their capstone course. 


How many students were included in the assessment of this outcome? 
10: Internship assessment (5) and Portfolio assessment (5) 


How were students selected to participate in the assessment of this outcome? 


1. Students create a digital portfolio with artifacts created throughout the program and submit the portfolio to the instructor as 
part of their capstone class. At the advanced level, the artifacts available in seniors’ portfolios were used to assess the learning 
outcomes. The links to graduating students’ digital portfolios were entered into a spreadsheet. 29 student portfolios were 
received in Spring 2017, Portfolio links were selected using the online randomizing tool, www.randomizer.com. Of the 29 
student portfolios received, 5 were selected for assessment, or 17 percent. 


2. Five student internship evaluation forms were randomly selected from a total of 19 sport media internship evaluations 
(www.randomizer.com), which represented 26 percent of the internship evaluations. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking ClPerformance or jury 

Rating of skills (e.g., rubrics) Measuring effectiveness relative to XVisual collection (photos, videos, etc.) 
X Analysis of written artifacts one Saree (Review of student research 
[JComprehensive, certification, or Linee sit thesla/gissertathan/ creative OOther (please specify): 


component 


professional exam(s) Click here to specify. 


X Capstone project 
(Oral presentation į pie 

EXInternshi 
OCourse project P 


OlInterviews 
OSatisfaction Survey 
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Describe the how the assessment method was implemented, administered, and/or conducted. 
In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 


1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


“See Appendix For Excel Sheet / Results 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 


1= Poor or no representation of Learning Outcome 
2= Somewhat poor representation of Learning Outcome 
3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


In the Internship Assessment, supervisors provided an overall assessment of Learning Outcome #7 — student demonstrates an 
understanding of the writing, editing and production techniques of mass communication specialties 
Internship Supervisors were asked to assess the student’s work and rate the work on a 7-point-scale. 


1= Not Applicable 
a= Understanding Not Demonstrated 
3e Demonstrated Only Slightly 
4= Demonstrated Occasionally 
= Demonstrated But Needs Work 
6= Demonstrated Well 
7= Expertly Demonstrated 
Did your department/program faculty have a goal set for this learning outcome? KlYes CINo 


Yes, to score better than in 2016 — Internship Evaluations (5.2/7) / Portfolios (4.2/5) 
*New for 2017 — one SMSC professor was selected to evaluate portfolios. 


Provide a summary of the results from the assessment of Learning Outcome 7. 
Internship Assessment Score: The overall mean score was 5.8, which is slightly higher than the 2016 score of 5.2. Goal achieved. 


Portfolio Assessment Score: The mean score was 3.65, which is lower than in 2016. Goal not achieved, Faculty need to review 
portfolios in all classes, and more writing samples across different platforms need to be added to student portfolios. 


SMSC Professor Portfolio Score: 3.8 





What do the results suggest about student achievement of this learning outcome? 

Students must add more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how 
to write effectively across multiple platforms. Faculty need to do more portfolio reviews and must meet with industry leaders to 
understand best industry practices and what skills are expected by industry professionals when students graduate. 


Timeline for the Assessment 


CEach Semester lYearly O Every other year 
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Page # Document 

15. Senior Exit Survey Sample 

16. Senior Interview questions 

17. Portfolio Assessment survey 

22. Portfolio Assessment Results — Excel Sheet 
23. Internship Evaluations by Supervisor 





Senior Survey 


Name: 





Circle one answer that reflects your level of achievement: 





Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and 
ethical principles involved in mass communication. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning Outcome 2: Students will demonstrate an understanding of the relevance of human diversity in mass 
communication. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning Outcome 3: Students will demonstrate respect for the history and social role of mass communications. 
Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning outcome 5: Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


Learning outcome 8: Students will demonstrate an understanding of the relevant planning and management methods 
in mass communication. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 
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Senior Interview Questions 


1. Now that you’re about to graduate, what stands out most about your education in the past four years? 

2. Do you plan to work in your field of study? 

3. What subject matter / classes were the most difficult to learn in your major? How did you do in the class? 
Do you still remember what you learned? 

. What did you learn that you feel is most beneficial to you? Why? 

. Do you think diversity is important in your field of study? Why? 

. Do you think you learned a lot about the history of our profession? 

. Where do you think you will be in your career in five years? 

. What things would you have liked to learn that you didn’t? 

. Would you feel comfortable researching and planning an event or campaign? 

10, How do you feel about this accomplishment? 


won nun fs 


Congratulations! You’re an alumnae or alumnus. 





Portfolio Assessment Survey 


Learning Outcomes Survey 


i 





Portfolio Assessment 


The purpose of this survey is to help us assess the quality of our program and students’ ability to demonstrate learning outcomes. 
Please assess each of the learning outcomes based on the artifacts presented in the portfolios assigned to you. 


* 1, What is your name? 








2. What is name of the student whose portfolio you are analyzing? 


ES 

















Learning Outcomes Survey 


\ 
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Learning Outcome 4 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions. 


* 3, The ability to analyze complex situations accurately. 
©) No or poor representation of learning outcome. 

C) Somewhat poor representation of learning outcome. 

Y ph s E 

() Average representation of learning outcome. 


C) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 4. The ability to craft innovative solutions to difficult problems. 
C) No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
() Average representation of learning outcome. 
(C) Good representation of learning outcome. 


©) Outstanding representation of learning outcome. 


* 5, The ability to look beyond what is obvious and understand what lies beneath the surface. 
C) No or poor representation of learning outcome. 
(-) Somewhat poor representation of learning outcome. 
© Average representation of learning outcome. 
©) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 6, The ability to effectively communicate complex ideas and make them understandable. 
©) No or poor representation of learning outcome. 
() Somewhat poor representation of learning outcome. 
(O) Average representation of learning outcome. 
(.) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 














Learning Outcomes Survey 





Learning Outcome 6 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 
Select the level of representation of the above learning outcome in the portfolio based on each of the following questions. 


* 7. Evidence of the ability to gather information effectively and completely. 
©) No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
(O) Average representation of learning outcome. 
©) Good representation of learning outcome. 


C) Outstanding representation of learning outcome. 


* 8 Evidence of initiative and creativity in information gathering. 
C) No or poor representation of learning outcome. 
©) Somewhat poor representation of learning outcome. 
() Average representation of learning outcome. 
C) Good representation of learning outcome. 


©) Outstanding representation of learning outcome. 


* 9, The ability to use multiple methods and sources to research information. 
©) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
() Average representation of learning outcome. 
C) Good representation of learning outcome. 


(O Outstanding representation of learning outcome. 


* 10. The ability to effectively communicate how information was gathered. 
Č) No or poor representation of learning outcome. 
C) Somewhat poor representation of learning outcome. 
C) Average representation of learning outcome. 
©) Good representation of learning outcome. 


(C) Outstanding representation of learning outcome. 








A Learning Outcomes Survey 
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Thank you 


We appreciate you sharing your time and expertise. 











External Reviewer Results - Portfolios 
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Column P question for reviewers: Is the portfolio professional and will it help the student find employment after graduation? 


B 

‘SPM alt whi 
Shipka 4 4 3 4 4 4 3 4 4 4 4 4 
Shipka 3 3 3 3 4 3 4 4 4 3 4 3 
Shipka 4 4 4 4 4 4 4 4 4 4 4 3 
Shipka 4 4 4 4 4 4 3 3 3 4 3 4 
Shipka 4 4 4 4 5 5 4 44 4 4 4 5 

3.8 3.8 3.6 3.8 4.2 4 3.6 3.8 3.8 3.8 3.8 3.8 





22 





Internship Supervisor Survey 













To what extent does the intern demonstrate the following 
characteristics? 

















Not applicable 

Not demonstrated 
Demonstrated only slightly 
Demonstrated occasionally 
Demonstrated but needs work 
Demonstrated well 

Expertly demonstrated 





Re ee ee 
ee es el ee 
a) Ee ee, 
i ee 
Le ee ls 


1. An understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass 
communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 





3. An understanding of the history and social role of mass 
communications. 





4. Critical, creative and individual thinking. 








5. An understanding of the relevant theories and concepts 
of mass communications. 






6. An understanding of the methods and techniques of 
research and information gathering. 






7. Appropriate writing, editing and production techniques in 
mass communications. 






8. An understanding of relevant planning and management 
methods in mass communications. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Arts 
Multimedia Journalism 





DAHANA School of Media & Strategic Communication 
Multimedia Journalism — Bachelor of Arts 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





® 


Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 40 
Number of students graduated in 2017-2018: 12 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Critical thinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

e  Problem-solving skills 

e Diversity 

e Leadership 

e Community involvement 





C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 











D. Student Learning Outcomes 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 





Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2,3,5&8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 


Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 
briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students were asked to rate 
the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey 
C Rating of skills (e.g., rubrics) 
ClAnalysis of written artifacts 


XComprehensive, certification, or 
professional exam(s) 


CoOral presentation 
OCourse project 


OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 


CJBenchmarking 


O Measuring effectiveness relative to 
professional standards 


C Review of thesis/dissertation/ creative 
component 


O Capstone project 
Ointernship 


Interviews 


LlPerformance or jury 

Ovisual collection (photos, videos, etc.) 
OReview of student research 

Clother (please specify): 

Click here to specify. 


Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


* Questions 21 -30 pertain to Mass Communication Law 


e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


X Yes XNo 





Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 


MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 
Average score for all SMSC students who took the pretest: 50 percent 
Average score for MMJ — BA students who took the pretest 21 percent 


Questions measuring Learning Outcome #1: 


Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 
Posttest: 
Average score for all SMSC students who took the posttest: 67 percent 
Average score for MMJ-BA students who took the posttest: 38 percent 


Questions measuring Learning Outcome #1: 


The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 
Senior Exits: 
The average for Learning Outcome #1: 5 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
* Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester KlYearly CJEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey OBenchmarking [1Performance or jury 
CRating of skills (e.g., rubrics) Ll Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 


rofessional standards 
Analysis of written artifacts p C Review of student research 
O Review of thesis/dissertation/ creative 


conpanent COther (please specify): 


Cicomprehensive, certification, or 
prifiessional erami 2 Click here to specify. 
. (Capstone project 

(Oral presentation 


DInternshi 
C)Course project p 


Interviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? XYes LINo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.7 out of 5, which achieves the goal. 
Senior students “agree” they have an understanding of the history and social roles in mass communications. 


What do the results suggest about student achievement of this learning outcome? 


Goal Achieved. 4.7 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
{Each Semester OYearly ClEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 


Fall 2017 & Spring 2018 Pre Test: 
Spring 2018 Post Test: 
Senior Exits: 

Total: 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of 


the learning outcome. 


Assessment Methods 


Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey 
CRating of skills (e.g., rubrics) 
LJAnalysis of written artifacts 


[]Comprehensive, certification, or 
professional exam(s) 


DOral presentation 
C1Course project 


OSatisfaction Survey 


CBenchmarking 


C Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


LlCapstone project 
Olnternship 


ClInterviews 


[Performance or jury 

Ovisual collection (photos, videos, etc.) 
Review of student research 

COther (please specify): 

Click here to specify. \ 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 


xXINo 





Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3; 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits: Goal achieved 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press in a 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

* Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

e Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 


effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
Xl Each Semester XYearly LlEvery other year 








D4) Student Learning Outcome #4: Students will demonstrate critical, creative anid independent thinking ds they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 - Electronic Reporting 

e SC 3353 - Persuasive Writing 

e SC 3363 — Graphic Design 

* SC 3463 — Event Planning 

e SC 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


&lSurvey C Benchmarking OPerformance or jury 

Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
DAnalysis of written artifacts Prefessinnyal Eaa OReview of student research 
[1Comprehensive, certification, or Likeview ahthass/Abseregony cheats (lOther (please specify): 


component 


professional GRAMS Click here to specify. 


CiCapstone project 
OOral presentation P pro 


Olinternshi 
OCourse project 5 


s ; OInterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
e ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

¢ ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

* ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


2. External reviewers each reviewed five portfolios. Reviewers received two links: 
e linkto a student portfolio 
e link to an online survey. 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 


scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes RINO 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 6.2 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3.8 out of 5 Goal achieved 
Internal Portfolio Reviews: 4 out of 5 No goal set during first year 
Internship Evaluations: 6.2 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Results indicate that there was a lack of hard journalism or in-depth reporting in the portfolios. Additional hard-hitting/in-depth 
stories are required in the capstone class. Suggestions include a non-sport news story and perhaps one story that includes an FOIA 


filing. 


Timeline for the Assessment 
XEach Semester Xl Yearly CEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Xl Survey OBenchmarking (Performance or jury 
ORating of skills (e.g., rubrics) CJ Measuring effectiveness relative to OVvisual collection (photos, videos, etc.) 
rofessional standards 
OHAnalysis of written artifacts p CReview of student research 
C Review of thesis/dissertation/ creative 


&lComprehensive, certification, or ClOther (please specify): 


i component 
professional exam(s) 


jec li ere to specify. 
O t roject fi 
CoOral presentation Capstone proj Click h 


Ointernshi 
CCourse project p 


Interviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? XYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.5 out of 5. 





What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 
theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 


Timeline for the Assessment 
Each Semester kl Yearly LlEvery other year 





D6) Student Learning Outcome #6: Students wil! demonstrate an understanding of the methods and techniques oj 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods. All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1, Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2, 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey C1Benchmarking (Performance or jury 
Rating of skills (e.g., rubrics) & Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
XlAnalysis of written artifacts P C)Review of student research 
C Review of thesis/dissertation/ creative 


LlComprehensive, certification, or OOther (please specify): 


; component 
professional exam(s) 


Oc ‘ t Click here to spec fy. 
Oor al pr esentation 


Internshi 
(Course project p 


; OInterviews 
UO Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability gather information (Excel Column H) 

* ifthe student used creativity to gather information (Excel Column !) 

e ifthe student’s work used multiple methods & sources to research (Excel Column J) 

e ifthe student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
e link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes CNo 
External portfolio reviews: Score better than 2017 (2017 average was 3.9 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.2) 





Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.93 out of 5 — Goal achieved 
Internal portfolio reviews: 4 out of 5 - No goal set 
Internship Evaluations: 6.2 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


XJEach Semester XlYearly ClEvery other year 
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D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Portfolios: 
Internships: 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey 
X Rating of skills (e.g., rubrics) 
XlAnalysis of written artifacts 


CL1Comprehensive, certification, or 


OBenchmarking 


O Measuring effectiveness relative to 
professional standards 


C Review of thesis/dissertation/ creative 
component 


Performance or jury 
Xl Visual collection (photos, videos, etc.) 
CO Review of student research 


[Other (please specify): 


professional exam(s) Click here tospectty 


X Capstone project 
OOral presentation p pa 


Internshi 
OCourse project R 


Olnterviews 
CO Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? KYes LINo 


Score better than 2017 (2017 average was 3.8 out of 5) 
No goal set in 2018 
Score better than 2017 (2017 average was 6.6) 


External Portfolio Reviews: 
Internal Portfolio Reviews: 
Internship Evaluations; 


Provide a summary of the results from the assessment of Learning Outcome 7. 
External Portfolio Reviews: 3.4 out of 5 — goal not achieved 

Internal Portfolio Reviews: 4 out of 5—no goal set 

Internship Supervisor Reviews: 6.2 out of 7 — goal not achieved 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester lYearly CEvery other year 





D8) Student Learning Outcome #8: Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 
How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey OBenchmarking Performance or jury 

C Rating of skills (e.g., rubrics) O Measuring effectiveness relative to LVisual collection (photos, videos, etc.) 
OMAnalysis of written artifacts professional sahats OReview of student research 
Ocomprehensive, certification, or Eifevienn nning isentinieny create OOther (please specify): 


š component 
nrofessianal-exsmn(s) Click here to specify. 


CCapstone project 
OoOral presentation accel a 


OInternshi 
OCourse project p 


Interviews 
CSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KYes CINo 
Score 4+ or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 3.75 out of 5 — goal not achieved 


What do the results suggest about student achievement of this learning outcome? 
MMI faculty need to address this Learning Outcome in appropriate classes. Seniors scored this as the lowest Learning Outcome 


Timeline for the Assessment 
Yearly Every other year 
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E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated, 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 


assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8, Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 





Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 





The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 


Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree —1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree -5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5, Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 








Internship Supervisor Learning Outcome Evaluation 
























5 
To what extent does the intern demonstrate the following PSREN ca 
. . u 
characteristics? S2| 8s] S¥ 2 
zol S| zs >57 
c= c= c Bc 
on on on oo 
5 > 5 8 5 3 a E 
aos|as5/oe ns 









N 








1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 













2. An understanding of the relevance of human diversity in 
mass communications. 













3. An understanding of the history and social role of mass 
communications. 








CO pere 









4. Critical, creative and individual thinking. 









5. An understanding of the relevant theories and concepts of 
mass communications. 









6. An understanding of the methods and techniques of 
research and information gathering. 








7. Appropriate writing, editing and production techniques in mass 
communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Teaming Outconre d 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 

No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


np WN 


The ability to craft innovative solutions to difficult problems. 
No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nak UNE 


The ability to look beyond what is obvious and understand what lies beneath the surface. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


UA WN 


The ability to effectively communicate complex ideas and make them understandable. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nf UNA 
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learning Outconie 6 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


U oe U Ne 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome, 


ok wn 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


ot UU Ne 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Vearming Outconie 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


ob WNP 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome, 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


wm e UNA 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


UvO wW Ne 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


ot WN PR 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Conclusion 


The portfolio is professional and will help the student find employment after graduation 


oP WN 


5 Strongly Agree. 

4 Agree. 

3 Neither agree nor disagree. 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 


25% wy 75% 1G 


Average Grade 


Class Average: bower e 4 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


U ser Sta tistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 


OW 25% Sow 75% 1005% 


Average Grade 


Class Average: 1——- -m 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Science 
Multimedia Journalism 





onfvrritn School of Media & Strategic Communication 
Multimedia Journalism — Bachelor of Science 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





® 


Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 


Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 54 
Number of students graduated in 2017-2018: 16 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Critical thinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

e  Problem-solving skills 

e Diversity 

e Leadership 

e Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media, Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 








D. Student Learning Outcomes 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 





Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2,3,5&8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 
Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation oj the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 
briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students were asked to rate 
the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey Benchmarking (Performance or jury 


ORating of skills (e.g., rubrics) 
ClAnalysis of written artifacts 


XComprehensive, certification, or 
professional exam(s) 


(Oral presentation 
Course project 


CSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 


O Measuring effectiveness relative to 
professional standards 


C Review of thesis/dissertation/ creative 
component 


LCapstone project 
CInternship 


Klinterviews 


Ovisual collection (photos, videos, etc.) 
OReview of student research 

COther (please specify): 

Click here to specify. 


Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester, All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 


e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


X Yes KINo 





Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 
Average score for all SMSC students who took the pretest: 50 percent 
Average score for MMJ — BS students who took the pretest 21 percent 


Questions measuring Learning Outcome #1: 


Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 
Posttest: 
Average score for all SMSC students who took the posttest: 67 percent 
Average score for MMJ-BS students who took the posttest: 35 percent 


Questions measuring Learning Outcome #1: 


The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 
Senior Exits: 
The average for Learning Outcome #1: 5 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
* Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester xl Yearly ClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking O Performance or jury 


ORating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 


professional standards 


DAnalysis of written artifacts OReview of student research 


C Review of thesis/dissertation/ creative 
CL1comprehensive, certification, or component / / OOther (please specify): 
professional exam(s) k 3 
, Click here to specify. 
r L1Capstone project 
OOral presentation 


OInternshi 
CiCourse project p 


s Interviews 
DSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey, 


Did your department/program faculty have a goal set for this learning outcome? Yes CONo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.7 out of 5, which achieves the goal. 
Senior students “agree” they have an understanding of the history and social roles in mass communications. 


What do the results suggest about student achievement of this learning outcome? 


Goal Achieved. 4.7 out of 5, Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
Each Semester OYearly ClEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of 
the learning outcome. 


Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey C1Benchmarking L Performance or jury 
ORating of skills (e.g., rubrics) O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
rofessional standards 
LJAnalysis of written artifacts p OReview of student research 
OReview of thesis/dissertation/ creative 
OComprehensive, certification, or / / COther (please specify): 
3 component 
professional exam(s) ; : 
: Click here to specify. \ 
j LCapstone project 
(1Oral presentation 
ClInternshi 
OCourse project ẹ 
Olnterviews 


OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? KlYes XINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits: Goal achieved 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press in a 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

e Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
XlEach Semester XlYearly Every other year 





D4) Student Learning Outcome #4: students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 — Electronic Reporting 

e SC 3353 - Persuasive Writing 

e SC 3363 — Graphic Design 

e SC 3463 — Event Planning 

e §C 3953 — Research Methods 

* SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking (Performance or jury 

XlRating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
OAnalysis of written artifacts proresaonat standarda CiReview of student research 
LComprehensive, certification, or IRE HIEW GF SESS ORSEFECE DN, CREE OOther (please specify): 


component 


prettasstorehengints) Click here to specify. 


(Capstone project 
OOral presentation P ii: 


Ointernshi 
OCourse project p 


Olnterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability to analyze complex situations accurately (Excel Column D) 
e if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


2. External reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
e link to an online survey. 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes XINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 6.2 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3.8 out of 5 Goal achieved 
Internal Portfolio Reviews: 4 out of 5 No goal set during first year 
Internship Evaluations: 6.2 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Results indicate that there was a lack of hard journalism or in-depth reporting in the portfolios. Additional hard-hitting/in-depth 
stories are required in the capstone class. Suggestions include a non-sport news story and perhaps one story that includes an FOIA 
filing. 


Timeline for the Assessment 
XlEach Semester Yearly Clevery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 15 


Spring 2018 Post Test: 8 
Senior Exits: 4 
Total: 27 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected, Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome, 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey CBenchmarking []Performance or jury 
DRating of skills (e.g., rubrics) O Measuring effectiveness relative to visual collection (photos, videos, etc.) 
rofessional standards 
(Analysis of written artifacts p OReview of student research 
C Review of thesis/dissertation/ creative 


&lComprehensive, certification, or OOther (please specify): 


à component 
professional exam(s) 


; Click here to specify. 
CCapstone project 
ClOral presentation R Bm 


C)Internshi 
OCourse project P 


Interviews 
USatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KlYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.5 out of 5, 





What do the results suggest about student achievement of this learning outcome? 
Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 


theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 


Timeline for the Assessment 
Xl Each Semester Yearly ClEvery other year 


1 





D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques oj 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods. All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total; 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XxlSurvey Benchmarking ClPerformance or jury 
Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p COReview of student research 
C Review of thesis/dissertation/ creative 


Licomprehensive, certification, or (Other (please specify): 


: component 
professional exam(s) 


Click here to specify, 
Capstone project 
OoOral presentation P proj 


Internshi 
COCourse project 3 


. i OlInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
° ifthe student’s work reflected the ability gather information (Excel Column H) 

» ifthe student used creativity to gather information (Excel Column |) 

e if the student’s work used multiple methods & sources to research (Excel Column J) 

» ifthe student had the ability communicate how information was gathered (Excel Column K) 


, Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
e linkto an online survey. 


N 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
External portfolio reviews: Score better than 2017 (2017 average was 3.9 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.2) 





Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.93 out of 5 — Goal achieved 
Internal portfolio reviews: 4 out of 5 - No goal set 
Internship Evaluations: 6.2 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


XlEach Semester Yearly [JEvery other year 


13 








D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties, 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2, Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey OBenchmarking Performance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to Xl Visual collection (photos, videos, etc.) 
A : rofessional standards : 
Analysis of written artifacts p CReview of student research 
O Review of thesis/dissertation/ creative 


OComprehensive, certification, or ClOther (please specify): 


3 component 
professional exam(s) 


Da Capstone project Click here to specify. 
(Oral presentation 


Internshi 
(Course project 5 


CInterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? xlYes ONo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.8 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.6) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 3,4 out of 5 — goal not achieved 
Internal Portfolio Reviews: 4 out of 5 — no goal set 
Internship Supervisor Reviews: 6.2 out of 7 — goal not achieved 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


XlEach Semester Yearly LlEvery other year 
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D8) Student Learning Outcome #8: students will demonstrate an understanding of relevant planning Gnd management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation, The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey CiBenchmarking (Performance or jury 
ORating of skills (e.g., rubrics) Cl Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
(Analysis of written artifacts P CReview of student research 
OReview of thesis/dissertation/ creative 


[1Comprehensive, certification, or COther (please specify): 


f component 
professional exam(s) 


z Click here to specify. 
L1Capstone project 
(Oral presentation R prel 


OInternshi 
OCourse project 4 


Interviews 
Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KYes LINo 
Score 4+ or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8, 
Score was 3.75 out of 5 — goal not achieved 


What do the results suggest about student achievement of this learning outcome? 
MMI] faculty need to address this Learning Outcome in appropriate classes. Seniors scored this as the lowest Learning Outcome 


Timeline for the Assessment 
XlYearly ClEvery other year 





E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 
p 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 


and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 
Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs, 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 


assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations, 





G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 


No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 








Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 


The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 





Senior Exit Survey 


1, Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3, Learning Outcome #3; Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5. Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 
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Internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


he 


2. An understanding of the relevance of human diversity in 
mass communications. 


Rie =e fal 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 





5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in mass 
communications. 





8. An understanding of relevant planning and management 
methods in mass communications. 


pet ht e 218 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Learning Outconied: | 


Learning Outcome 4; Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 


nk wn Re 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


The ability to craft innovative solutions to difficult problems. 


1 
2 
3 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to look beyond what is obvious and understand what lies beneath the surface. 


1 
2 
a 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome, 


The ability to effectively communicate complex ideas and make them understandable. 


ob WN 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 
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Learning Outcomes 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


ne wn 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome, 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome, 


nae U Ne 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Uu oe U Ne 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome, 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Teaming Outcome 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


mf WN 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


mf WN RP 


22 











Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


oP wn 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


mW bw Ne 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Conclusion 


The portfolio is professional and will help the student find employment after graduation 


nk U Ne 


5 Strongly Agree. 

4 Agree, 

3 Neither agree nor disagree, 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


U ser Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 





Average Grade 


Class Average: et re ry 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


U ser Sta tisti cs Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 


grs 23% UA 75% 1005% 


Average Grade 


Class Average: Pt en a ey 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 











2017 - 2018 
Annual Assessment Report 


Bachelor of Arts 
Strategic Communication 





OKLAHOMA School of Media & Strategic Communication 
Strategic Communications — Bachelor of Arts 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY. 





Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2017-2018: 82 
Number of students graduated in 2017-2018: 32 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Critical thinking 

e Creativity 

* Global awareness 

¢ Appreciation for the liberal arts 

e Adaptability 

*  Problem-solving skills 

* Diversity 

e Leadership 

e Community involvement 








C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES [JNo 
if university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 





D. Student Learning Outcomes 


Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 





Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2,3,5&8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 
Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 


briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 24 


Spring 2018 Post Test: 18 
Senior Exits: 5 
Total: 47 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey Benchmarking OPerformance or jury 
CRating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p C Review of student research 
O Review of thesis/dissertation/ creative 


XIComprehensive, certification, or OOther (please specify): 


. component 
professional exam(s) 


P Click here to specify. 
CCapstone project 
OoOral presentation p PE 


OiInternshi 
OCourse project j 


> Interviews 
OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test; All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21-30 pertain to Mass Communication Law 
* Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? KlYes XI No 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SC — BA students who took the pretest 20 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law); 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SC-BA students who took the posttest: 31 percent 
Questions measuring Learning Outcome #1: 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.7 out of 5 


What do the results suggest about student achievement of this learning outcome? 

Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. The post scores were lower than expected. However, this is the first year for the exam. Scores can 
be improved by replacing some questions to better reflect the learning outcome. Things to consider this year and as we move 


forward: 
e Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
° Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 


full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester XlYearly ClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the 
relevance of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia 
journalism curricula, including but not limited to data journalism, reporting and media management. 

How many students were included in the assessment of this outcome? 

5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed all graduating seniors asking for participation, The first five students (from 
each program) to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to 
rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking Performance or jury 
CRating of skills (e.g., rubrics) C Measuring effectiveness relative to Ovisual collection (photos, videos, etc.) 


’ rofessional standards 3 
OAnalysis of written artifacts P CReview of student research 
COReview of thesis/dissertation/ creative 


component COther (please specify): 


LlComprehensive, certification, or 
professional exarti(s) Click here to specify 
, CCapstone project ; 
OOral presentation 


OInternshi 
CiCourse project p 


Interviews 
C)Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes, After the interview, students 
completed a Learning Outcome survey that included the following ratings scale: 


Did your department/program faculty have a goal set for this learning outcome? XlYes CINo 
Goal: receive a rating of 4.2+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 

Senior Exits: Learning Outcome #2 received a rating of 4.6 out of 5, which achieves the faculty goal. 

Senior students “strongly agree” they understand and have learned a lot about the relevance and need for diversity in mass media 
and communications. No weaknesses discovered. 


What do the results suggest about student achievement of this learning outcome? 


Goal Achieved. 4.6 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
XK Each Semester OYearly ClEvery other year 








D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 
communications. 
Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 24 


Spring 2018 Post Test: 18 
Senior Exits: 5 
Total: 47 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey C1Benchmarking C)Performance or jury 
(Rating of skills (e.g., rubrics) O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
rofessional standards 
DAnalysis of written artifacts P OReview of student research 
C Review of thesis/dissertation/ creative 


ClComprehėnsive, certification, or ClOther (please specify): 


é component 
professional exam(s) 


y cli ify. 
] Fltapstone project ick here to specify. \ 
OOral presentation 


OInternshi 
OCourse project 


OiInterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? klYes xINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 





Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits 

Seniors rated this outcome: 4.2/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press in a 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

* Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history, social roles and diversity. 


Timeline for the Assessment 
Each Semester Kl Yearly CEvery other year 





D4) Student Learning Outcome #4: Students will demonstrate critical, creative and Independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 - Electronic Reporting 

e $C 3353 - Persuasive Writing 

e SC 3363 — Graphic Design 

e §C 3463 — Event Planning 

* §C 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 





1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Èd Survey 
Rating of skills (e.g., rubrics) 
Analysis of written artifacts 


[1Comprehensive, certification, or 
professional exam(s) 


OoOral presentation 
COCourse project 


(Satisfaction Survey 


CBenchmarking 


& Measuring effectiveness relative to 
professional standards 


CO Review of thesis/dissertation/ creative 
component 


OCapstone project 
Olnternship 


OInterviews 


C)Performance or jury 

Visual collection (photos, videos, etc.) 
Review of student research 

OOther (please specify): 

Click here to specify. 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 

e ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 
e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


N 


link to a student portfolio 
link to an online survey. 


. External reviewers each reviewed five portfolios. Reviewers received two links: 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 


scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes KXINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internship Evaluations: Score better than 2017 (2017 average was 6.7 out of 7) 

Internal Portfolio Review: First year — no goal 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 4 out of 5 Goal achieved 
Internal Portfolio Reviews: 4,1 out of 5 No goal set during first year 
Internship Evaluations: 6.8 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Portfolios: Students are better than average at problem solving and critical thinking. Scores increased from 2017. 

The major needs to do a better job helping students analyze complex situations. Although their ability to communicate complex 
situations is better, more rigor in complex problem-solving throughout the entire curriculum should be introduced. Perhaps it’s a 
generational thing as the rise of social media has made it convenient to glide across information without proper in-depth analysis. 
However, it is important for SMSC students to understand the ramifications of complex problems and the art of finding purposeful 


solutions. 


Timeline for the Assessment 
Each Semester XlYearly LlEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 
concepts of mass communication. 
Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 


Fall 2017 & Spring 2018 Pre Test; 24 


Spring 2018 Post Test: 18 
Senior Exits: 5 
Total: 47 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey 


CRating of skills (e.g., rubrics) 


OBenchmarking 


C Measuring effectiveness relative to 
professional standards 


C Performance or jury 
OVisual collection (photos, videos, etc.) 


CO Review of student research 


DiAnalysis of written artifacts 
C Review of thesis/dissertation/ creative 


corhponient COther (please specify): 


&lComprehensive, certification, or 

rofessi i ; 
poa Ficanstone niotect Click here to specify. 
COral presentation p i: 


OlInternshi 
(Course project g 


Xlinterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? XlYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 

Posttest — 42 percent answered correctly 

Seniors ranked this learning outcome as 4.6 out of 5. Goal achieved. 
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What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled from the pre to post test, which indicates a positive learning curve. However, scores are still low. 
Recommendations: SMSC should add two more questions to better assess mass communication history, diversity in mass 
communication and the importance of a free press in a democratic society. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 
Senior students “strongly agree” they understand and have learned a lot about the relevant theories and concepts of mass 


communications. 


Timeline for the Assessment 
kxlEach Semester Yearly LlEvery other year 
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D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques of 


research und information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students in Strategic Communication are required to take a course in Research Methods. All students are required to use 
research and data in their capstone project. Students must also demonstrate research skills when collecting data for writing 
courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X)Survey (Benchmarking (Performance or jury 
Xl Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
XlAnalysis of written artifacts C)Review of student research 
C Review of thesis/dissertation/ creative 


[JComprehensive, certification, or ClOther (please specify): 


A component 
professional exam(s) 


Cicanstone project Click here to specify. 
OoOral presentation 


KJinternshi 
OCourse project P 


a Olnterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 


1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
* ifthe student’s work reflected the ability gather information (Excel Column H) 

e ifthe student used creativity to gather information (Excel Column 1) 

» ifthe student’s work used multiple methods & sources to research (Excel Column J) 

° if the student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
External portfolio reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 
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Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.91 out of 5 — Goal achieved 
Internal portfolio reviews: 3.91 out of 5 - No goal set 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done, Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


Each Semester Yearly CEvery other year 
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D7) Student Learning Outcome #7: Students wil! demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey COBenchmarking Cl Performance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to )Visual collection (photos, videos, etc.) 
p , p rofessional standards n 
XAnalysis of written artifacts P OReview of student research 
O Review of thesis/dissertation/ creative 


CComprehensive, certification, or OOther (please specify): 


š component 
professional exam(s) 


f XCapstone project Click here to specify. 
OoOral presentation 


Xl Internshi 
(Course project i 


OlInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 4.3 outof 5 
Internal Portfolio Reviews: 3.8 out of 5 
Internship Supervisor Reviews: 6.8 out of 7 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


XEach Semester klYearly LlEvery other year 
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D8) Student Learning Outcome #8: Students will demonstrate an understonding of relevant planning and management 
methods in mass communication 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns, 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey OBenchmarking (Performance or jury 
Rating of skills (e.g., rubrics) C Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
OMAnalysis of written artifacts P OReview of student research 
O Review of thesis/dissertation/ creative 
Ocomprehensive, certification, or component / / OOther (please specify): 
professional exam(s) ‘ } 
‘ Click here to specify. 
P []Capstone project 
Oral presentation 
OInternship 


ClCourse project 


Interviews 
Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted, 
Senior Exit Interview & Survey; Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? XYes ONo 
Score 4.4 out of 5 (2017 score) 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 4.8 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 
concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
KlYearly DEvery other year 





E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 
assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 





interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 


Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 
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Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 





The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 





H. Assessment Tools 





Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree -5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3; Students will demonstrate respect for the history and social role of mass communications 
Strongly agree-5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5, Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 
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Internship Supervisor Learning Outcome Evaluation 


To what extent does the intern demonstrate the following 
characteristics? 


Not demonstrated 
Demonstrated 
only slightly 
Demonstrated 
occasionally 
Demonstrated but 
needs work 
demonstrated 


Expertly 


+ 
> 





1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 





7. Appropriate writing, editing and production techniques in mass 
communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 





3 
g 
$ 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Yearning Outcomes , 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 


ua fw DM Be 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to craft innovative solutions to difficult problems. 


wb WN Be 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to look beyond what is obvious and understand what lies beneath the surface. 


1 
2 
3 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to effectively communicate complex ideas and make them understandable. 


ot wWN 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome, 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 
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Teaming Outconie G 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nA UNBe 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Uv oe U Ne 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


v oA NUNE 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Learning Outcome 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


nb won 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nb wn Pe 
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Evidence of the ability to craft language for interesting and effective commuication, 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nF WN 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


oa Oe W Ne 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Gonclusión 


The portfolio is professional and will help the student find employment after graduation 


on A WW Ne 


5 Strongly Agree. 

4 Agree. 

3 Neither agree nor disagree. 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users ssu 





Average Grade 


Class Average: poeeme eee ey 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts Nagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 





Average Grade 


Class Average: | ee ny 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempls flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Science 
Strategic Communication 





TUTIL School of Media & Strategic Communication 
Strategic Communications — Bachelor of Science 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 





Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 196 
Number of students graduated in 2017-2018: 63 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

e Criticalthinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

* Problem-solving skills 

e Diversity 

e Leadership 

* Community involvement 





C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field, Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
ə Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 








D. Student Learning Outcomes 
Learning outcome 1. 





Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 


Learning outcome 2. 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 


Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 


communication. 


Learning outcome 5. 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 


Students will demonstrate an understanding of the writing, editing and production techniques of mass 


communication specialties. 


Learning outcome 8. 


Students will demonstrate an understanding of relevant planning and management methods in mass 


communication. 


Method 

Senior exits 

Portfolio Assessment 
Pre-Post Test 


Internship Assessment 


Measured 

Learning Outcomes 1, 2,3,5&8 
Learning Outcomes 4, 6 and 7 
Learning Outcomes 1, 3, 5, 7 


Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 
briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 55 


Spring 2018 Post Test: 46 
Senior Exits: 5 
Total: 106 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey OBenchmarking Performance or jury 
ORating of skills (e.g., rubrics) Ll Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
à , rofessional standards , 
ClAnalysis of written artifacts & (Review of student research 
O Review of thesis/dissertation/ creative 


Comprehensive, certification, or OOther (please specify): 


i component 
professional exam(s) 


- Ceanstonaprojert Click here to specify. 
OOral presentation 


OiInternshi 
Course project P 


Interviews 
Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MM) 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 
e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes XI No 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SC — BS students who took the pretest 21 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SC — BS students who took the pretest 32 percent 
Questions measuring Learning Outcome #1: 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.7 out of 5 


What do the results suggest about student achievement of this learning outcome? 

Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. The post scores were lower than expected, However, this is the first year for the exam. Scores can 
be improved by replacing some questions to better reflect the learning outcome. Things to consider this year and as we move 


forward: 
e Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


XlEach Semester XYearly OlEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications, 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to 
respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Xl Survey Benchmarking O Performance or jury 
CO Rating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 


professional standards 


L1Analysis of written artifacts (Review of student research 


OReview of thesis/dissertation/ creative 


[lComprehensive, certification, or (Other (please specify): 


: component 
professional exam(s) : F 
Ticapsranapedject Click here to specify. 
OoOral presentation 
CInternship 


(Course project 


Interviews 
(Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey that included the following ratings scale: 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
Goal: receive a rating of 4.2+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 

Report student’s scores for this assessment, as well as students’ strengths and weaknesses relative to this learning outcome. 
Senior Exits: Learning Outcome #2 received a rating of 4.6 out of 5, which achieves the faculty goal. 

Senior students “strongly agree” they understand and have learned a lot about the relevance and need for diversity in mass media 
and communications. No weaknesses discovered. 


What do the results suggest about student achievement of this learning outcome? 
Goal Achieved. 4.6 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 
XlEach Semester OYearly LlEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. 


How many students were included in the assessment of this outcome? 


Fall 2017 & Spring 2018 Pre Test: 55 


Spring 2018 Post Test: 46 
Senior Exits: 5 
Total: 106 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were 
selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of 


the learning outcome. 


Assessment Methods 


Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey 
(Rating of skills (e.g., rubrics) 
CAnalysis of written artifacts 


[]Comprehensive, certification, or 
professional exam(s) 


OOral presentation 
[Course project 


DSatisfaction Survey 


CBenchmarking 


O Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


OCapstone project 
CInternship 


Uinterviews 


O Performance or jury 

OVisual collection (photos, videos, etc.) 
C]Review of student research 

ClOther (please specify): 

Click here to specify. \ 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace, 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 


KINo 








Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits 

Seniors rated this outcome: 4.2/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free pressina 

democratic society, Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

> Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Goal achieved. Seniors are comfortable with their knowledge of mass communication history and social role of mass 


communication. 


Timeline for the Assessment 
XEach Semester XYearly ClEvery other year 








D4) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 — Electronic Reporting 

* $C 3353 - Persuasive Writing 

* SC 3363 — Graphic Design 

e SC 3463 — Event Planning 

* SC 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

* SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey Benchmarking OPerformance or jury 
lRating of skills (e.g., rubrics) XI Measuring effectiveness relative to KlVisual collection (photos, videos, etc.) 


rofessional standards 3 
DAnalysis of written artifacts P C Review of student research 
C Review of thesis/dissertation/ creative 


component OOther (please specify): 


Comprehensive, certification, or 
professional exam(s) Click here to specify 

: C1 Capstone project i 
OOral presentation 


C1 Internshi 
C1Course project p 


> ‘ OiInterviews 
CO Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
e ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

* ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


2. External reviewers each reviewed five portfolios. Reviewers received two links: 
e link to a student portfolio 
e linkto an online survey. 





2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student's work and rate the work on a seven-point- 


scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes KINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internship Evaluations: Score better than 2017 (2017 average was 6.7 out of 7) 

Internal Portfolio Review: First year — no goal 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 4 out of 5 Goal achieved 
Internal Portfolio Reviews: 4.1 out of 5 No goal set during first year 
Internship Evaluations: 6.8 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Portfolios: Students are better than average at problem solving and critical thinking. Scores increased from 2017. 

The major needs to do a better job helping students analyze complex situations. Although their ability to communicate complex 
situations is better, more rigor in complex problem-solving should be introduced. Perhaps it’s a generational thing as the rise of 


social media has made it convenient to glide across information without proper in-depth analysis. However, it is important for SMSC 


students to understand the ramifications of complex problems and the art of finding purposeful solutions. 


Timeline for the Assessment 
XlEach Semester Yearly LlEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 55 


Spring 2018 Post Test: 46 
Senior Exits: 5 
Total: 106 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey [1Benchmarking C)Performance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to CVisual collection (photos, videos, etc.) 
rofessional standards 
DAnalysis of written artifacts p C Review of student research 
Review of thesis/dissertation/ creative 
XiComprehensive, certification, or component / / Oother (please specify): 
professional exam(s) : , 
s Click here to specify. 
, OCapstone project 
OOral presentation 
Olnternship 


ClCourse project 


’ Interviews 
D Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? lYes ONo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 

Posttest — 42 percent answered correctly 

Seniors ranked this learning outcome as 4.6 out of 5. 
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What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled from the pre to post test, which indicates a positive learning curve. However, scores are still low. 
Recommendations: SMSC should add two more questions to better assess mass communication history, diversity in mass 
communication and the importance of a free press in a democratic society. 


Senior Exits: 

Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the faculty goal. 

Senior students “strongly agree” they understand and have learned a lot about the relevant theories and concepts in mass 
communications. 


Timeline for the Assessment 
Each Semester KlYearly O Every other year 





D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methacs and techniques of 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students in Strategic Communication are required to take a course in Research Methods. All students are required to use 
research and data in their capstone project. Students must also demonstrate research skills when collecting data for writing 
courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey C1Benchmarking (]Performance or jury 

XRating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
XlAnalysis of written artifacts professional standards ClReview of student research 
(1Comprehensive, certification, or Lil fevieima? theals/esseriaten/ nreatve OOther (please specify): 


component 


professional exam(s) Click here to specify. 


O Capstone project 
OOral presentation P pisi 


Xinternshi 
Course project p 


OInterviews 
QSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
* ifthe student’s work reflected the ability gather information (Excel Column H) 

e ifthe student used creativity to gather information (Excel Column |) 

¢ ifthe student’s work used multiple methods & sources to research (Excel Column J) 

» ifthe student had the ability communicate how information was gathered (Excel Column K) 


. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
* link to an online survey. 


N 


2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
External portfolio reviews: Score better than 2017 (2017 average was 3.66 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 





Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.91 out of 5 — Goal achieved 
Internal portfolio reviews: 3.91 out of 5- No goal set 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


KlEach Semester xl Yearly ClEvery other year 
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D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1, Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey C Benchmarking C1Performance or jury 

Rating of skills (e.g., rubrics) O Measuring effectiveness relative to XI Visual collection (photos, videos, etc.) 
Analysis of written artifacts professional snes OReview of student research 
CLicomprehensive, certification, or Einiwlew of tresis/dlsseetet ery ateoitur LlOther (please specify): 


component 


professional exam(s} Click here to specify. 


X Capstone project 
OoOral presentation 5 prol 


Xinternshi 
OCourse project P 


eo UiInterviews 
DSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? lYes LINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 4.3 out of 5 
Internal Portfolio Reviews: 3.8 out of 5 
Internship Supervisor Reviews: 6.8 out of 7 
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What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester XlYearly ClEvery other year 
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D8) Student Learning Outcome #8: Students will demonstrate an understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 
How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five students to respond were selected. Students 
were interviewed in person and completed a paper survey. Students were asked to rate the level of understanding of the learning 


outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


X Survey Benchmarking OPerformance or jury 
ORating of skills (e.g., rubrics) C Measuring effectiveness relative to Ovisual collection (photos, videos, etc.) 
rofessional standards 
C Analysis of written artifacts j OReview of student research 
OReview of thesis/dissertation/ creative 


CiComprehensive, certification, or Other (please specify): 


A component 
professional exam(s) 3 k 
Pitapstone project Click here to specify. 
OoOral presentation 
Onternshi 
[Course project 4 
interviews 


OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 
Score same or better than 2017. 2017 score was 4.4 out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 4.8 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 


concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
KlYearly ClEvery other year 





E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role, New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 


assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 





Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 





The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content, 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey, 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 





H. Assessment Tools 


Senior Exit Survey 


1, Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4, Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5. Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 





Internship Supervisor Learning Outcome Evaluation 


To what extent does the intern demonstrate the following 
characteristics? 


Not applicable 
Not demonstrated 
Demonstrated 
only slightly 
Demonstrated 
Demonstrated but 
needs work 


occasionally 
demonstrated 


N| Expertly 














1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


2. An understanding of the relevance of human diversity in 
mass communications. 


3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. 


5. An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 


7. Appropriate writing, editing and production techniques in mass 
communications. 


8. An understanding of relevant planning and management 
methods in mass communications. 


D 
D 
g 
= 
a 
+ 
fe) 
E 
oa 
oO 3 


ae ls el eee S a D 
aS es Se a ae a eR 





20 





Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Learning Outcone4: 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 
No or poor representation of learning outcome. 


Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


nt WN 


The ability to craft innovative solutions to difficult problems, 
No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nos WN PR 


The ability to look beyond what is obvious and understand what lies beneath the surface. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nt WN PR 


The ability to effectively communicate complex ideas and make them understandable. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


af WN PR 
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Tearing Outconie g 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome., 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


n A UNG 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


aot wn re 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nn fF wWN 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Ueamning Outcome: / 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


nF wn eB 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


of WN PR 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


np wn 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


mt wn Pe 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The portfolio is professional and will help the student find employment after graduation 


op WN RP 


Strongly Agree. 

Agree. 

Neither agree nor disagree. 
Disagree. 

Strongly Disagree. 


PNW AM 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


U ser Sta tistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 





Average Grade 


Class Average: y amema a emea a- 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 








Percentage of Users 





Average Grade 


Class Average: r ae re ae 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Arts 
Sports Media 





TETIT School of Media & Strategic Communication 
Sport Media — Bachelor of Arts 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 





Assessment Coordinator’s Email Address: gina.noble@okstate.edu 





Number of students enrolled in the program 2017-2018: 54 
Number of students graduated in 2017-2018: 13 





B. Program Mission Statement 


In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 

* = Critical thinking 

e Creativity 

e Global awareness 

e Appreciation for the liberal arts 

e Adaptability 

e Problem-solving skills 

* Diversity 

e Leadership 

* Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? X YES LINo 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
e 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
e Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 











D. Student Learning Outcomes 





Learning outcome 1. 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 


Learning outcome 2. 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 


Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 


communication. 


Learning outcome 5. 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 


Students will demonstrate an understanding of the writing, editing and production techniques of mass 


communication specialties. 


Learning outcome 8. 


Students will demonstrate an understanding of relevant planning and management methods in mass 


communication. 


Method 

Senior exits 

Portfolio Assessment 
Pre-Post Test 


Internship Assessment 


Measured 

Learning Outcomes 1, 2, 3, 5 & 8 
Learning Outcomes 4, 6 and 7 
Learning Outcomes 1, 3, 5, 7 


Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 


briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey C)Benchmarking C]Performance or jury 
ORating of skills (e.g., rubrics) OMeasuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
OAnalysis of written artifacts p OReview of student research 
OReview of thesis/dissertation/ creative 


IComprehensive, certification, or COther (please specify): 


> component 
professional exam(s) 


[ Click her t i F 
Ora r i LCapstone project ! eto specify 


CInternshi 
CCourse project j 


: > Interviews 
OSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 
e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? X Yes XI No 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 








Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SPM — BA students who took the pretest 21 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SPM-BA students who took the posttest: 36 percent 
Questions measuring Learning Outcome #1; 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.4 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
*  Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 
full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication, 


Timeline for the Assessment 


Xl Each Semester klYearly OClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of humar 
diversity in mass communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey 
ORating of skills (e.g., rubrics) 
OAnalysis of written artifacts 


Cicomprehensive, certification, or 


CBenchmarking 


C Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


CPerformance or jury 
OVisual collection (photos, videos, etc.) 
OReview of student research 


OOther (please specify): 


piotendonal enone) F Click here to specify. 
: CCapstone project 
LOral presentation 


OInternshi 
OCourse project p 


Xinterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted, 
Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? KlYes CINo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.4 out of 5, which achieves the goal. 
Senior students “agree” they have an understanding of the history and social roles in mass communications. 


What do the results suggest about student achievement of this learning outcome? 
Goal Achieved. 4.4 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 


Each Semester OYearly LlEvery other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for Lhe history and social role of mass 


communications. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of masscommunications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: p 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester, All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 


Brightspace during the final few weeks of the semester. 


Senior Exit Survey; Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected, Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 


understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


OSurvey CBenchmarking 


ORating of skills (e.g., rubrics) O Measuring effectiveness relative to 


rofessional standards 
C Analysis of written artifacts p 


OReview of thesis/dissertation/ creative 


Comprehensive, certification, or 
component 


professional exam(s) 
OCapstone project 
OoOral presentation ili 


Ointernshi 
Course project 3 H 


OIntervi 
OSatisfaction Survey nterviews 


(Performance or jury 

Ovisual collection (photos, videos, etc.) 
CiReview of student research 

COther (please specify): 

Click here to specify. \ 


Describe the how the assessment method was implemented, administered, and/or conducted, 


Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 


interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 


XI No 








Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 55 percent 
Senior Exits 

Seniors rated Learning Outcome #3: 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press ina 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

e Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

* Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

* Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 
effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
Each Semester KlYearly CEvery other year 








D4) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 

e MC 2003 - Media Style & Structure 

e MC 2023 — Electronic Reporting 

e SC 3353 - Persuasive Writing 

e §C 3363 — Graphic Design 

e SC 3463 — Event Planning 

e SC 3953 — Research Methods 

e SC 4493 — Advanced PR Writing 

e SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


lSurvey Cl Benchmarking OPerformance or jury 
X Rating of skills (e.g., rubrics) X Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
rofessional standards 
ClAnalysis of written artifacts p OReview of student research 
C Review of thesis/dissertation/ creative 


Ccomprehensive, certification, or (Other (please specify): 


i component 
professional exam(s) 


l Ciĉapstoie project Click here to specify. 
LOral presentation 


OiInternshi 
Course project k 


Olnterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1, Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability to analyze complex situations accurately (Excel Column D) 
e if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

ə ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


. External reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
link to an online survey. 


N 








2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes Xx] No 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.65 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 5.8 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3.3 out of 5 Goal not achieved 
Internal Portfolio Reviews: 3.5 out of 5 No goal set during first year 
Internship Evaluations: 6.6 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Results indicate that there was a lack of hard journalism or in-depth reporting in the portfolios. Additional hard-hitting/in-depth 
stories are required in the capstone class. Suggestions include a non-sport news story and perhaps one story that includes an FOIA 
filing. 


Timeline for the Assessment 
Each Semester XlYearly DEvery other year 





D5) Student Learning Outcome #5: Students wil! demonstrate an understanding of the relevant theories ond 


concepts of mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester, 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking CPerformance or jury 
ORating of skills (e.g., rubrics) CO Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
rofessional standards 
Analysis of written artifacts p C Review of student research 
O Review of thesis/dissertation/ creative 


Xl Comprehensive, certification, or COther (please specify): 


i component 
professional exam(s) 


; Click here to specify, 
CCapstone project 
OoOral presentation p pe 


Olnternshi 
OCourse project p 


y ; Interviews 
CSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? lYes CINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.6 out of 5. 








What do the results suggest about student achievement of this learning outcome? 
Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 


theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the faculty goal. 


Timeline for the Assessment 
Each Semester klYearly O Every other year 





D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques of 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods, All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


&lSurvey O Benchmarking OPerformance or jury 

Rating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
XlAnalysis of written artifacts protistrana OReview of student research 
[1Comprehensive, certification, or neviem afithatls/alssemiations trente COther (please specify): 


component 


professional exam(s) Click here to specify. 


C Capstone project 
CoOral presentation i i 


Internshi 
Course project P 


: CInterviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
e ifthe student’s work reflected the ability gather information (Excel Column H) 

e if the student used creativity to gather information (Excel Column 1) 

e ifthe student’s work used multiple methods & sources to research (Excel Column J) 

> ifthe student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
e link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes ONo 
External portfolio reviews: Score better than 2017 (2017 average was 3.77 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 
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Provide a summary of the results from the assessment of Learning Outcome 6. 


External portfolio reviews: 3.91 out of 5 — Goal achieved 
Internal portfolio reviews: 3.15 out of 5 - No goal set 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Programs should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


Each Semester klYearly ClEvery other year 





D7) Student Learning Outcome #7: Students will demonstrate an understanding of the writing, editing and production 


techniques of mass communication specialties. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


ÈI Survey O Benchmarking Performance or jury 

Rating of skills (e.g., rubrics) O Measuring effectiveness relative to Visual collection (photos, videos, etc.) 
Analysis of written artifacts professightl standas OReview of student research 
Licomprehensive, certification, or Higiea arih /Msarhaan mosie COther (please specify): 


component 


hrofessional exams) Click here to specify. 


X Capstone project 
OoOral presentation p proj 


Internshi 
OCourse project p 


UiInterviews 
DSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? klYes CINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 3.4 out of 5 — goal not achieved 
Internal Portfolio Reviews: 3.15 out of 5 
Internship Supervisor Reviews: 6.8 out of 7 — goal achieved 
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What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester XYearly Every other year 





D8) Student Learning Outcome #8: Students will demonstrate on understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected, Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
identify the method(s) used to assess this learning outcome. Check all that apply. 


KSurvey 
O Rating of skills (e.g., rubrics) 
LAnalysis of written artifacts 


Comprehensive, certification, or 
professional exam(s) 


OOral presentation 
O Course project 


O Satisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 


OBenchmarking 


O Measuring effectiveness relative to 
professional standards 


OReview of thesis/dissertation/ creative 
component 


CCapstone project 
OInternship 


interviews 


(Performance or jury 

OVisual collection (photos, videos, etc.) 
CReview of student research 

COther (please specify): 

Click here to specify. 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale, 


Did your department/program faculty have a goal set for this learning outcome? 


Score 4.4 or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 


Score was 4.6 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 
concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
Xl Yearly 


ClEvery other year 


ONo 
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E. Summary of Assessment Results 





Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 
perceived as trivia should be eliminated. 


The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 
assessment cycle. 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 
interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 
Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 


interpreting assessment data. 
The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 





Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 





No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 
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Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 


The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content. 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 





Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4. Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5, Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 





internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 


E: 





2. An understanding of the relevance of human diversity in 
mass communications. 





3. An understanding of the history and social role of mass 
communications. 








4. Critical, creative and individual thinking. 








5. An understanding of the relevant theories and concepts of 
mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 





7. Appropriate writing, editing and production techniques in mass 
communications. 





8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


Leaning Outcome 4 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 


aA UNa 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to craft innovative solutions to difficult problems. 


mewn 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


The ability to look beyond what is obvious and understand what lies beneath the surface. 


1 
2 
3 
4 
5 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The ability to effectively communicate complex ideas and make them understandable. 


mon Pwond Fe 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 
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Learning, Outcome (6) 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome, 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


own pe 


Evidence of initiative and creativity in information gathering, 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


op WN 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nt U NHE 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


Learning Outconre’7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


noA U Ne 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


U eA U Ne 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


mot wonr 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


u A UNa 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The portfolio is professional and will help the student find employment after graduation 


me WU Ne 


5 Strongly Agree. 

4 Agree. 

3 Neither agree nor disagree. 
2 Disagree. 

1 Strongly Disagree. 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


U ser Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 





Average Grade 


Class Average: et 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded. 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 





0% 25% ww 75% 


Average Grade 


Class Average: t= ——————— 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2017 - 2018 
Annual Assessment Report 


Bachelor of Science 
Sports Media 








pam School of Media & Strategic Communication 
Sport Media — Bachelor of Science 


Assessment Report Form 2017-2018 
(fall 2017, spring & summer 2018) 


UNIVERSITY, 





® 


Date of Report: 9/1/2018 


Name of Person Submitting Report: Gina Noble 


A. Program Information: 
Assessment Coordinator’s Name: Gina Noble 


Assessment Coordinator’s Email Address: gina.noble@okstate.edu 
Number of students enrolled in the program 2017-2018: 98 
Number of students graduated in 2017-2018: 28 


B. Program Mission Statement 
In the box below, provide the mission statement for the program. 
To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be 
responsible and effective communicators who facilitate and promote participation in a democratic society through excellence in 
practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma State University School of 
Media & Strategic Communications will do this by promoting: 
e = Critical thinking 
Creativity 
Global awareness 
Appreciation for the liberal arts 
Adaptability 
Problem-solving skills 
Diversity 
Leadership 
Community involvement 


C. University Assessment Funds 
Were university assessment funds used by the department/program for assessment activities? XYES No 
If university assessment funds were used by the department or program, describe how university assessment funds were used and the 
contribution the funds had on the assessment process. Funding requests for the next academic year have a separate process and should 
not be included here. 
1. Funds were used to pay: 
e 15 external reviewers — all reviewers were SMSC alumni who work professionally in the field. Each assessed a random sample 
of five students’ digital portfolios. 
ə 3 internal reviewers — one faculty member from each of SMSC’s three programs: strategic communications, multimedia 
journalism and sport media. Each assessed a random sample of students’ digital portfolios. 
ə Travel to Chicago to meet with two alumni working in the communications field. Both alumni served as external reviewers. 
Discussed best practices for professional portfolios, internship opportunities and curriculum. 
The funding demonstrates OSU’s commitment to annual assessment and assessment procedures, and paying reviewers for their time 
helps them understand the importance of their task. Reviewers spent hours studying student work and providing insightful comments, 
which helps SMSC faculty better understand our students’ strengths and weaknesses. In turn, faculty are able to make beneficial 
adjustments in their course work. 





D. Student Learning Outcomes 
Learning outcome 1. 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved 


in mass communication. 


Learning outcome 2. 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Learning outcome 3. 
Students will demonstrate respect for the history and social role of mass communications. 


Learning outcome 4. 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass 
communication. 


Learning outcome 5. 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Learning outcome 6. 
Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Learning outcome 7. 
Students will demonstrate an understanding of the writing, editing and production techniques of mass 
communication specialties. 


Learning outcome 8. 
Students will demonstrate an understanding of relevant planning and management methods in mass 
communication. 


Method Measured 

Senior exits Learning Outcomes 1, 2, 3,5 & 8 
Portfolio Assessment Learning Outcomes 4, 6 and 7 
Pre-Post Test Learning Outcomes 1, 3, 5, 7 
Internship Assessment Learning Outcomes 4, 6, 7 





D1) Student Learning Outcome #1: Students will demonstrate an appreciation of the constitutional 
freedoms, legal issues and ethical principles involved in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

Mass Communication Law and Media Ethics are required “core” courses for all SMSC students. Mass Communication Law 
addresses constitutional freedoms and legal issues. Ethics covers ethical principles and some constitutional freedom issues. 
Other classes, including Introduction to Strategic Communication, Introduction to Journalism and Media in a Diverse Society, 


briefly discuss legal issues, ethical issues and constitutional freedoms. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 31 


Spring 2018 Post Test: 16 
Senior Exits: 5 
Total: 52 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Exam: All students enrolled in Media Style & Structure (core curriculum class) are required to take the SMSC Pre Test. All 
students enrolled in a senior capstone course are required to take the SMSC Post Test. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students from each of the 
three programs were selected. Students were interviewed in person and completed a paper survey at the end of the interview. Students 
were asked to rate the level of understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XJSurvey ClBenchmarking C)Performance or jury 

ORating of skills (e.g., rubrics) [Measuring effectiveness relative to Clvisual collection (photos, videos, etc.) 
OAnalysis of written artifacts professional standards OReview of student research 
Comprehensive, certification, or OiReview of thesis/dissertation/ creative ClOther (please specify): 


component 


professional exam(s} Click here to specify 


C)Capstone project 
Oral presentation p pec 


Olnternshi 
OCourse project p 


; : KllInterviews 
KSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 

Pre-Post test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


e Questions 21 -30 pertain to Mass Communication Law 
e Questions 31-40 pertain to Ethics 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? KlYes KINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 





Provide a summary of the results from the assessment of Learning Outcome 1. 
Seniors in capstone courses (3 programs) took the exam together — the numbers below reflect the average of 191 students in SC, 
MMJ and SPM. Test scores could not be divided among the three programs. 


Pretest: 

Average score for all SMSC students who took the pretest: 50 percent 

Average score for SPM — BS students who took the pretest 22 percent 
Questions measuring Learning Outcome #1: 
Average score on questions 21-30 (mass communication law): 28 percent 
Average score on questions 31-40 (ethics): 62 percent 

Posttest: 

Average score for all SMSC students who took the posttest: 67 percent 

Average score for SPM-BS students who took the posttest: 35 percent 
Questions measuring Learning Outcome #1: 
The average score on questions 21-30: 55 percent 
The average score on questions 31-40 75 percent 

Senior Exits: 

The average for Learning Outcome #1: 4.4 out of 5 


What do the results suggest about student achievement of this learning outcome? 
Pre-Post test: Students did better on the posttest than on the pretest, suggesting that learning was occurring in Mass 
Communication Law and Ethics. However, this is the first year for the exam. Scores can be improved by replacing some questions to 
better reflect the learning outcome. Things to consider this year and as we move forward: 
ə Posttest scores on Questions 27-30 (mass communication law) were low because the material was presented during the 
end of the semester and possibly after the posttest was administered. 
e Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give 


full effort. 


Senior Exits: Goal achieved. Seniors demonstrate an appreciation for constitutional freedoms, legal issues and ethical principles in 
mass communication. 


Timeline for the Assessment 


Each Semester Yearly ClEvery other year 





D2) Student Learning Outcome #2: Students will demonstrate an understanding of the relevance of human 
diversity in mass communications: 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core course Media in a Diverse Society, which places considerable emphasis on the relevance 
of diversity in mass communications and the media. Also, the relevance of diversity is covered in all multimedia journalism 
curricula, including but not limited to data journalism, reporting and media management. 


How many students were included in the assessment of this outcome? 
5 


How were students selected to participate in the assessment of this outcome? 


Senior Exit Interview & Survey: Academic advisers emailed SPM graduating seniors asking for participation. The first five to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the Learning Outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


iSurvey 
ORating of skills (e.g., rubrics) 
CAnalysis of written artifacts 


Comprehensive, certification, or 
professional exam(s) 


(JOral presentation 
OCourse project 


LSatisfaction Survey 


C1 Benchmarking 


O Measuring effectiveness relative to 
professional standards 


Review of thesis/dissertation/ creative 
component 


CCapstone project 
CiInternship 


Interviews 


(Performance or jury 
OWVisual collection (photos, videos, etc.) 
Review of student research 
Clother (please specify): 
Click here to specify. 


Describe the how the assessment method was implemented, administered, and/or conducted. 


Students met with the associate director and talked about the program and the Learning Outcomes. After the interview, students 
completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
Goal: receive a rating of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 2. 
Senior Exits: Learning Outcome #2 received a rating of 4.4 out of 5. 


What do the results suggest about student achievement of this learning outcome? 
Goal Achieved. 4.4 out of 5. Seniors agree they understand the relevance of human diversity in mass communications. 


Timeline for the Assessment 


XJEach Semester LlYearly Every other year 





D3) Student Learning Outcome #3: Students will demonstrate respect for the history and social role of mass 
communications. 
Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 


All students are required to take the following core courses: Media in a Diverse Society, Mass Communication Law and Media 
Ethics. All of the courses include curricula on the history and social role of mass communications. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 


Pre-Post Test: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMI 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


CSurvey LiBenchmarking (Performance or jury 
ORating of skills (e.g., rubrics) O Measuring effectiveness relative to Oisual collection (photos, videos, etc.) 
, , ; rofessional standard 3 
OAnalysis of written artifacts ee ia CReview of student research 
OReview of thesis/dissertation/ creative 


CComprehensive, certification, or ponent COther (please specify): 


professional exam(s) : ; 
A Click here to specify. \ 
ClCapstone ect 
OoOral presentation ap Hea 


CInternshi 
ClCourse project P 


OInterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test: Online test administered during class in Brightspace. 


Senior Exit Survey: Students met with the associate director and talked about the program and the Learning Outcomes. After the 
interview, students completed a Learning Outcome survey. 


Did your department/program faculty have a goal set for this learning outcome? XYes XINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 
Yes for Senior Exits Goal: receive a score of 4+ out of 5 





Provide a summary of the results from the assessment of Learning Outcome 3. 


Pretest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions - #41-50 59 percent 
Posttest: 

Questions measuring Learning Outcome #3: 

History & Social Role questions -#41-50 55 percent 
Senior Exits 

Seniors rated Learning Outcome #3: 4/5 


What do the results suggest about student achievement of this learning outcome? 

Posttest: Scores on the post-test were lower than the pretest. Faculty need to revise a few “Media in a Diverse Society” pre-post 

questions to better assess students’ understanding of history of mass communication and the importance of a free press ina 

democratic society. Remove the trivia questions and replace them with history, social roles of mass communication and diversity in 

mass communication. Things to consider: 

e Students who take the pretest have recently completed the class or are enrolled in the class at the same time as the pretest. 

e Seniors taking the posttest may not recall the information because most took “Media in a Diverse Society” during their first 
year. 

ə Students were not rewarded (grades or points) for taking the test. It is possible some students in the posttest did not give full 


effort. 


Senior Exits: 
Seniors are comfortable with their knowledge of mass communication history and social roles. 


Timeline for the Assessment 
Each Semester lYearly CEvery other year 





D4) Student Learning Outcome #4: Students will demonstrate critical, creative and independent thinking as they relate to 


individual disciplines in mass communication. 


identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
This learning outcome is likely the most important component in all the courses in the degree. Students are challenged in their 
writing and reporting courses to critically assess information and audiences before presenting in the form of written artifacts. 
Courses would include: 
e MC 2003 - Media Style & Structure 
e MC 2023 -Electronic Reporting 
SC 3353 - Persuasive Writing 
SC 3363 — Graphic Design 
SC 3463 — Event Planning 
SC 3953 — Research Methods 
SC 4493 — Advanced PR Writing 
SC 4843 — Campaigns 


How many students were included in the assessment of this outcome? 


1, Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 





Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


ilSurvey OBenchmarking Performance or jury 
XRating of skills (e.g., rubrics) Measuring effectiveness relative to &Visual collection (photos, videos, etc.) 


rofessional standards s 
OAnalysis of written artifacts p OReview of student research 
O Review of thesis/dissertation/ creative 


component COther (please specify): 


Comprehensive, certification, or 


professional exam(s) Click here to specify. 


CCapstone project 
OoOral presentation ap projec 


Ointernshi 
Course project nternsnip 


OInterviews 
LSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #4 assessed by external reviewers in four categories: 
e ifthe student's work reflected the ability to analyze complex situations accurately (Excel Column D) 
ə ifthe student was able to craft innovative solutions to difficult problems (Excel Column E) 

e ifthe student’s work reflected looking beyond the obvious (Excel Column F) 

e ifthe student had the ability to effectively communicate complex ideas (Excel Column G) 


_ External reviewers each reviewed five portfolios. Reviewers received two links: 
link to a student portfolio 
link to an online survey. 


N 








2. Internship Evaluation assessment survey, Learning Outcome #4 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes KINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.65 out of 5) 

Internal Portfolio Review: First year — no goal 

Internship Evaluations: Score better than 2017 (2017 average was 5.8 out of 7) 


Provide a summary of the results from the assessment of Learning Outcome 4. 


External Portfolio Reviews: 3,6 out of 5 Goal achieved 
Internal Portfolio Reviews: 3.5 out of 5 No goal set during first year 
Internship Evaluations: 6.6 out of 7 Goal achieved 


What do the results suggest about student achievement of this learning outcome? 

Results indicate there is room for improvement. Perhaps there is a lack of hard journalism stories or in-depth reporting in the 
portfolios, Additional hard-hitting/in-depth stories are required in the capstone class. Suggestions include a non-sport news story 
and perhaps one story that includes an FOIA filing. 


Timeline for the Assessment 
lEach Semester Yearly LlEvery other year 





D5) Student Learning Outcome #5: Students will demonstrate an understanding of the relevant theories and 


concepts af mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the following core courses: Media in a Diverse Society, Electronic Communications, Mass 
Communication Law and Media Ethics. All of the courses include material on the relevant theories and concepts of mass 
communications. In addition, strategic communications students are exposed to and asked to apply to the relevant theories and 
concepts of Strategic Communications through most of the courses in SC, including the capstone course. 


How many students were included in the assessment of this outcome? 
Fall 2017 & Spring 2018 Pre Test: 19 


Spring 2018 Post Test: 11 
Senior Exits: 5 
Total: 35 


How were students selected to participate in the assessment of this outcome? 

Pre-Post Exam: All students enrolled in MC 2003 - Media Style & Structure - took an online pretest in Brightspace during the first few 
weeks of the semester. All students enrolled in SC 4843, SPM 4883 and MMJ 4973 (capstone courses) took an online posttest in 
Brightspace during the final few weeks of the semester. 


Senior Exit Survey: Academic advisers emailed all graduating seniors asking for participation. The first five students (from each program) 
to respond were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XlSurvey Benchmarking Performance or jury 
CRating of skills (e.g., rubrics) C Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
fessional standards 
LAnalysis of written artifacts is 5 OReview of student research 
OReview of thesis/dissertation/ creative 


Comprehensive, certification, or Other (please specify): 


i component 
professional exam(s) 


‘ Click here to specify. 
Capstone project 
OOral presentation p pro 


Llinternshi 
(Course project Serre 


; Interviews 
OSatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 
Pre-Post Test; Online test administered during class in Brightspace 


Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a survey that included a ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? lYes CINo 
No for pre-post test: 2018 was the first year to pre-and-post test. 


Yes for Senior Exits Goal: receive a score of 4+ out of 5 


Provide a summary of the results from the assessment of Learning Outcome 5. 
One question (#21) on the pre-post test measured an understanding of the theory. 
Pretest — 21 percent answered correctly 
Posttest — 42 percent answered correctly 


Seniors ranked Learning Outcome #5 as 4.6 out of 5. 





What do the results suggest about student achievement of this learning outcome? 

Posttest: Students’ scores doubled on this question (from pre to posttest), which indicates a positive learning curve of relative mass 
communication theories. However, scores are still low. Recommendation: SMSC faculty should include more mass communication 
theory in classes. 


Senior Exits: 
Senior Exits: Learning Outcome #5 received a rating of 4.6 out of 5, which achieves the goal. 


Timeline for the Assessment 
Each Semester Yearly ClEvery other year 


1] 








D6) Student Learning Outcome #6: Students will demonstrate an understanding of the methods and techniques of 


research and information gathering. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 
All students are required to take a course in Research Methods. All students are required to use research and data in their 
capstone project. Students must also demonstrate research skills when collecting data for writing courses. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


1. 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
2. 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey C1Benchmarking (Performance or jury 
XRating of skills (e.g., rubrics) Measuring effectiveness relative to Visual collection (photos, videos, etc.) 


‘ . rofessional standards y 
XAnalysis of written artifacts p OReview of student research 
CReview of thesis/dissertation/ creative 


japona COther (please specify): 


Licomprehensive, certification, or 
pRTRSslon glean} Click here to specify 

A OCapstone project : 
CoOral presentation 


Internshi 
Course project P 


r Cinterviews 
USatisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

1. Portfolio assessment survey: Learning Outcome #6 assessed by external reviewers in four categories: 
ə ifthe student’s work reflected the ability gather information (Excel Column H) 

e ifthe student used creativity to gather information (Excel Column l) 

ə ifthe student's work used multiple methods & sources to research (Excel Column J) 

e ifthe student had the ability communicate how information was gathered (Excel Column K) 


2. Internal and external reviewers each reviewed five portfolios. Reviewers received two links: 
ə link to a student portfolio 
e link to an online survey. 


2. Internship Evaluation assessment survey, Learning Outcome #6 was assessed in one category: critical, creative and 
independent thinking. Internship Supervisors were asked to assess the student’s work and rate the work on a seven-point- 
scale. 


Did your department/program faculty have a goal set for this learning outcome? Yes LINo 
External portfolio reviews: Score better than 2017 (2017 average was 3.7 out of 5) 

Internal portfolio reviews: No goal — new in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 6. 
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External portfolio reviews: 3.7 out of 5 — Goal achieved 
Internal portfolio reviews: 3.15 out of 5- No goal 
Internship Evaluations: 6.8 out of 7 — Goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores increased from 2017, but there is still work to be done. Faculty should discuss student portfolios and portfolio assignments. 


Timeline for the Assessment 


Each Semester XlYearly ClEvery other year 
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D7) Student Learning Outcome #7: Students wil) demonstrate un understanding of the writing, editing and production 


techniques of mass communication specialties, 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

All students are required to take the core courses in Style and Structure and Electronic Communication, and writing-specific 
courses in their degree program, in this case Persuasive Writing, Copywriting and Creative Strategy, Graphic Design and Advanced 
Public Relations Writing. In addition, strategic communications students are expected to demonstrate these skills in their 
capstone course by researching, developing, planning and writing a strategic communications campaign book. 


How many students were included in the assessment of this outcome? 


1. Students included in the portfolio assessment by external reviewers: 5 
2. Students included in the internship supervisor assessment: 5 
Total: 10 


How were students selected to participate in the assessment of this outcome? 


Portfolios: 5 student portfolio links were selected using the online randomizing tool, www.randomizer.com 
Internships: 5 student internship evaluation forms were randomly selected (www.randomizer.com) 








Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


Survey OBenchmarking OPerformance or jury 
Rating of skills (e.g., rubrics) O Measuring effectiveness relative to Visual collection (photos, videos, etc.) 


professional standards 


Analysis of written artifacts OReview of student research 


OReview of thesis/dissertation/ creative 


component LOther (please specify): 


C)Comprehensive, certification, or 

professional exam(s) r > 
3 Click here to specify. 

: XICapstone project 

CJOral presentation p PS 


Internshi 
OCourse project p 


Olnterviews 
Satisfaction Survey 


Describe the how the assessment method was implemented, administered, and/or conducted. 

Portfolios: External portfolio reviewers assess if the students’ work showed evidence of the ability to effectively and clearly, 
(column L), ability to craft interesting messages (column M), ability to write across media platforms (column N), ability to 
communicate with diverse audiences (column 0) 


Internships: Internship supervisors provide an overall assessment of this learning outcome via survey. 


Did your department/program faculty have a goal set for this learning outcome? Yes CINo 
External Portfolio Reviews: Score better than 2017 (2017 average was 3.6 out of 5) 

Internal Portfolio Reviews: No goal set in 2018 

Internship Evaluations: Score better than 2017 (2017 average was 6.7) 


Provide a summary of the results from the assessment of Learning Outcome 7. 


External Portfolio Reviews: 3.5 out of 5 — goal not achieved 
Internal Portfolio Reviews: 3 out of 5 
Internship Supervisor Reviews: 6.6 out of 7 — goal not achieved 





What do the results suggest about student achievement of this learning outcome? 

Scores have increased the past two years, which demonstrates a concerted effort to help students develop effective digital 
portfolios. To continue this trend, faculty must focus on portfolio items and portfolio reviews prior to graduation. Students must add 
more writing samples to their portfolios, and the writing samples should demonstrate an understanding of how to write effectively 
across multiple platforms and to diverse audiences. Faculty need to do more portfolio reviews and meet with industry leaders to 
understand best practices. 


Timeline for the Assessment: 


Each Semester Yearly ClEvery other year 





D8) Student Learning Outcome #8: Students wil/ demonstrate on understanding of relevant planning and management 
methods in mass communication. 


Identify opportunities for students to learn this outcome during the 2017-2018 academic year: 

The following courses offer curriculum that emphasize the importance of relevant planning and management methods in mass 
communications, more specifically strategic communications: Persuasive Writing, SC Management & Strategies, Advertising 
Copywriting, Media & Markets, Advanced PR Writing and SC Campaigns. 


How many students were included in the assessment of this outcome? 
9 
How were students selected to participate in the assessment of this outcome? 


Academic advisers emailed all graduating seniors asking for participation. The first five strategic communication students to respond 
were selected. Students were interviewed in person and completed a paper survey. Students were asked to rate the level of 
understanding of the learning outcome. 


Assessment Methods 
Identify the method(s) used to assess this learning outcome. Check all that apply. 


XSurvey Benchmarking OPerformance or jury 

ORating of skills (e.g., rubrics) O Measuring effectiveness relative to OVisual collection (photos, videos, etc.) 
ClAnalysis of written artifacts professional standarts CReview of student research 
ClComprehensive, certification, or CiReview of thesis/dissertation/ creative COther (please specify): 


component 


professional exam(s) Click here to specify. 


ClCapstone project 
OoOral presentation p Proj 


Ointernshi 
[Course project Srema 


‘ Interviews 
LSatisfaction Survey 


Describe how the assessment method was implemented, administered, and/or conducted. 
Senior Exit Interview & Survey: Five students met with the associate director and talked about the program and the Learning 
Outcomes. After the interview, students completed a Learning Outcome survey that included the following ratings scale. 


Did your department/program faculty have a goal set for this learning outcome? klYes LINo 
Score 4.4 or better out of 5 


Provide a summary of the results from the assessment of Learning Outcome 8. 
Score was 4,6 out of 5 — goal achieved 


What do the results suggest about student achievement of this learning outcome? 
Scores exceeded the past two years. The School is doing a good job of presenting and incorporating planning and management 
concepts and relevant assignments in its curricula. 


Timeline for the Assessment 
lYearly ClEvery other year 
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E. Summary of Assessment Results 


Describe the overall results of the program assessment and program faculty members’ interpretation of the 


assessment results. 
Overall, all SMSC programs achieved positive results in the 2017-2018 assessment. Data collected from students, faculty, alumni, 
and external reviewers proves SMSC is successfully educating students and achieving positive results in the assessment of its eight 


Learning Outcomes. 


A faculty assessment committee reviewed the results. The committee agrees the pre-posttest should be altered to include questions 
that better assess all learning outcomes. No questions focused on diversity or mass communication’s social role. New questions 
should focus on mass communication theory, history, diversity and its social role in a democratic society. Questions that are 


perceived as trivia should be eliminated. 
The committee agrees faculty should create a plan to improve portfolio external review scores across all programs. 


The committee recommends reviewing each assessment method and restructuring the senior exit survey before the next 
assessment cycle, 


The committee recommends better assessment methods for Learning Outcomes #2 and #8. Each is measured by Senior Exit 


interview. The Faculty Assessment Committee questioned the validity of the method. The survey used must be changed to reflect all 
Learning Outcomes, and the survey should be offered digitally to all seniors. 


No changes recommended for internship assessment. 


F. Dissemination of Results 

Describe the individual(s) or committee (e.g., a curriculum committee) responsible for reviewing and 
interpreting assessment data. 

The Faculty Assessment Committee (area heads from SC, MMJ and SPM) reviewed three of the four assessment methods and will 
make suggestions / changes to the next round of assessment after meeting with entire faculty. 


Describe the process for sharing and discussing assessment results with program faculty. 
All faculty members will receive a copy before the September faculty meeting. Each program will meet to review and make 
recommendations. 


G. Program Improvements Based on Assessment 
Based on the findings of this assessment, what changes are being considered or planned for the program? 


No changes to program. 


However, faculty members should review curriculum to ensure mass communication theory, mass communication’s social role, mass 
communication history and mass communication diversity are covered across classes and questions on the exam match what is 
being taught across multiple sections. The committee will send a written report to the assessment coordinator. 





Based on the findings of this assessment, what (if any) changes are planned for the assessment process? 
The pre-posttest will be changed to include questions focusing on mass communication theory, history, diversity and its social role in 
a democratic society. Questions perceived as trivia will be eliminated. 


The pre-posttest should measure students’ scores across programs. Currently, the test data cannot be assessed by program. 
Changes will be made to the testing process. 


Portfolio improvement will be discussed in faculty and program meetings. Each program will create a plan to improve portfolio 
content. 


Recommended changes by the Faculty Assessment Committee will be made to Senior Exit survey. 


Internal reviewers will meet with program faculty to report portfolio assessment findings and discuss methods to improve portfolio 
content, 


The Faculty Assessment Committee will review and make recommended changes (if needed) for each assessment method. 
Internship data should be collected digitally. Changes will be made to internship supervisor evaluation reporting methods. 


All faculty should include Learning Outcomes that apply to their course in their syllabuses. 


Describe the process for implementing these changes/planned program improvements. 


Associate director will work with the director and Faculty Assessment Committee to review and/or implement changes in 
assessment methods. Changes will be discussed during faculty and program meetings. 
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H. Assessment Tools 


Senior Exit Survey 


1. Learning Outcome 1: Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles 
involved in mass communication? 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


2. Learning Outcome #2: Students will demonstrate an understanding of the relevance of human diversity in mass communication? 
Strongly agree - 5 
Agree - 4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


3. Learning Outcome #3: Students will demonstrate respect for the history and social role of mass communications 
Strongly agree - 5 
Agree -4 
Neutral - 3 
Disagree - 2 
Strongly disagree — 1 


4, Learning outcome #5 — Students will demonstrate an understanding of the relevant theories and concepts of mass 
communications. 

Strongly agree - 5 

Agree -4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 


5. Learning outcome #8: Students will demonstrate an understanding of the relevant planning and management methods in mass 
communication 

Strongly agree - 5 

Agree - 4 

Neutral - 3 

Disagree - 2 

Strongly disagree — 1 








Internship Supervisor Learning Outcome Evaluation 
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1. An understanding of the relevant constitutional freedoms, 
legal issues and ethical principles in mass communications. 





2. An understanding of the relevance of human diversity in 
mass communications. 





3. An understanding of the history and social role of mass 
communications. 


4. Critical, creative and individual thinking. E 
5, An understanding of the relevant theories and concepts of 
mass communications. 


6. An understanding of the methods and techniques of 
research and information gathering. 

















7. Appropriate writing, editing and production techniques in mass 
communications. 








8. An understanding of relevant planning and management 
methods in mass communications. 
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Internal & External Portfolio Review Survey 


What is your name? 
Your answer 


What is the name of the student whose portfolio you are analyzing? 
Your answer 


leaming Outcomes 


Learning Outcome 4: Demonstrate critical, creative and individual thinking. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


The ability to analyze complex situations accurately. 

No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


aee WN Fe 


The ability to craft innovative solutions to difficult problems. 
No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


A kwWNe 


The ability to look beyond what is obvious and understand what lies beneath the surface. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


uP WN RP 


The ability to effectively communicate complex ideas and make them understandable. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nk wWN e 
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Learning Outcomes 


Learning Outcome 6: Demonstrate an understanding of the methods and techniques of research and information gathering. 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to gather information effectively and completely. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


nt won & 


Evidence of initiative and creativity in information gathering. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nb won 


The ability to use multiple methods and sources to research information. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome, 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


mW oe U N RB 


The ability to effectively communicate how information was gathered. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome, 
Outstanding representation of learning outcome. 


Leanning Outcome 7 


Learning Outcome 6: Demonstrate appropriate writing, editing and production techniques in mass communication. 


nN FwWN FR 


Select the level of representation of the above learning outcome in the portfolio based on each of the following questions: 


Evidence of the ability to write clearly, without errors in grammar or construction. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


of WN 
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Evidence of the ability to craft language for interesting and effective commuication. 
No or poor representation of learning outcome. 

Somewhat poor representation of learning outcome. 

Average representation of learning outcome. 

Good representation of learning outcome. 

Outstanding representation of learning outcome. 


nbPwWN FR 


The ability to write across platforms effectively. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


nak WNA 


The ability to effectively communicate to a wide and diverse audience. 


No or poor representation of learning outcome. 
Somewhat poor representation of learning outcome. 
Average representation of learning outcome. 

Good representation of learning outcome. 
Outstanding representation of learning outcome. 


The portfolio is professional and will help the student find employment after graduation 


mb won ke 


Strongly Agree. 

Agree. 

Neither agree nor disagree. 
Disagree. 

Strongly Disagree. 


eNA 
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Pretest Results 


View Statistics - SMSC Pre-Curriculum Pretest ~ 


User Stats Question Stats Question Details 


User Statistics Export to CSV Export to Excel 


Score Distribution: 





Percentage of Users 





Average Grade 


Class Average: ee i et 50.41 % (Std Dev = 9.38 %) 


The Class Average is calculated on first attempts flagged as graded, 


Posttest Results 


View Statistics - SMSC Post Assessment Test Spring 2018 ~ 
User Stats Question Stats Question Details 
User Statistics Export to CSV Export to Excel 


Score Distribution: 


Percentage of Users 


Ow 25% 50%% 79% 100% 


Average Grade 


Class Average: bi er ej 66.83 % (Std Dev = 9.50 %) 


The Class Average is calculated on first attempts flagged as graded. 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Arts 
Sports Media 





Program Information Report 


Program (CAS) - SMSC - Sports Media (BA) - 479 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 

















2018 - 2019 
Program Information 


Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 30 

Total Number of Students Graduated: 11 

Number of Student Graduates from Stillwater Campus: 11 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 


Program (CAS) - SMSC - Sports Media (BA) - 479 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum, 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, sports media students demonstrated an understanding of the Learning Objectives, demonstrated a good representation 
of critical, creative and independent thinking, and demonstrated an understanding of the writing, editing and production 
techniques. 

Dissemination of Findings 

Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 

Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major’ to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Sports Media (BA) - 479 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Results represent a good representation of the learning outcome. All faculty should emphasize constitutional freedoms as well as 
relevant legal issues and ethical principles in their courses 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to take an 
exit survey 

What do the findings suggest about student achievement of this learning outcome?: Graduates demonstrate an appreciation of 
the constitutional freedoms, legal issues and ethical principles involved in mass communication. 


























09/26/2019 Generated by Nuventive Improve Page 1 0f8 





Program (CAS) - SMSC - Sports Media (BA) - 479 





Comprehensive, Certification, or Professional Exam/(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning and retaining information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students have an appreciation of the 
constitutional freedoms, legal issues and ethical principles involved in mass communication. 




















Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the relevance of human diversity in mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning about human 
diversity as they progress through the program 




















Outcome: #3 - History and social role of mass communications. 
Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 

role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

Goal is to score at least 4. 

Timeline for Assessment: annually. 

Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and social role of mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to participate 
in the survey 

What do the findings suggest about student achievement of this learning outcome?: Students adequately understand the 
history and social role of mass communications 



















Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class, The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 
press. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 




















Outcome: #4 - Critical, creative and independent thinking in mass 
communication 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 








independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 





(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4 /5 
Goal is 4+ 
Timeline for Assessment: Yearly 
Findings 
Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated a good representation of critical, creative and independent thinking as they relate to the field of 
sports media 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Student portfolios demonstrated a good 
representation of critical, creative and independent thinking as they relate to the field of sports media 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 6.5 / 7 











Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors said students demonstrated their critical, creative and independent as 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: Students earning internship credit must be 
evaluated by supervisors 

What do the findings suggest about student achievement of this learning outcome?: Students are skilled in critical, creative and 
independent thinking. 





Outcome: #5 - Relevant theories and concepts of mass 
communication 
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Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors exit survey (Active) 
* Learning Outcome Goal/Benchmark: 3.85 / 5 
Goal: 4/5 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students felt their coursework adequately required them to demonstrate knowledge of relevant theories and concepts of mass 
communication 

Number of Students Assessed: 7 














Number of Successful Students: 7 
How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 


survey 
What do the findings suggest about student achievement of this learning outcome?: While students felt positive about theories 
in their coursework, they need more exposure to theory. It is recommended that each sequence and the entire faculty discuss 


important theories to highlight in multiple classes. 














Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While students are proficient in identifying theories, more theory questions recommended, and faculty should select theories to 


be highlighted in multiple sequence classes. One question in the pre-post exam deals with theory. 
Number of Students Assessed: 140 


Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 


























Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: 5.6 / 7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure - many mark it as NA instead of giving a rating 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column |) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated an average to good representation of understanding of the methods and techniques used to 
gather information 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: selected from list of seniors using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Note... measuring informational gathering skills is difficult. 

















Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: 6 / 7 

Goal achieved: 
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Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Internship supervisors agree students are adequate in research and information gathering skills 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: credit internships must have supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: Students are adequate in research and 
information gathering skills, but there's always room for improvement. 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 








Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 








Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Reviewers determined that student portfolios were generally good in demonstrating an understanding of mass communications 
writing, editing and production techniques 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are proficient in writing but can 
do more to showcase their skills - students need to include many types of work in their digital portfolios. 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
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courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 
* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100, 
Post assessment scores were 83 / 100. 





Findings 
Reporting Period: 2018 - 2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 


09/20/2019 


Number of Students Assessed: 140 


Number of Successful Students: 140 
How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 


Structure and all students in strategic communication capstone classes 
What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 


information seems to be forgotten between sophomore and senior year. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.9 /5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 















mass media and communications. 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 
Number of Students Assessed: 7 


Number of Successful Students: 7 
How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 





09/20/2019 


survey 
What do the findings suggest about student achievement of this learning outcome?: students are adequate in their skills and 


knowledge of planning and management 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
effective communicators who facilitate and promote participation in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
change through lifelong learning. Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











Outcomes Assessment Methods Findings Use of Findings (Actions) | 

#1- Understanding constitutional Survey - Graduating seniors were Reporting Period: 2018 - 2019 

freedoms & legal and ethical asked to complete an online "exit" Conclusion: 4 - Exceeds Program Expectations (Advanced) 

principles - Students will demonstrate survey regarding Learning Results represent a good representation of the learning 

an appreciation of the constitutional Outcomes. The survey was given a outcome. All faculty should emphasize constitutional 

freedoms, legal issues and ethical few weeks before graduation. freedoms as well as relevant legal issues and ethical 

principles involved in mass * Learning Outcome principles in their courses (09/20/2019) 

communication. Goal/Benchmark: Goal achieved: 4.4 Number of Students Assessed: 7 

Outcome Status: Active The goal was to receive a mean Number of Successful Students: 7 

Planned Assessment Year: 2018 - score of at least 4 (out of 5)oneach How were students selected to participate in the 

2019 question in the senior exit survey, assessment of this outcome?: all graduating seniors were 
which would indicate graduating invited to take an exit survey 
seniors “agree” they understand and What do the findings suggest about student achievement 
have learned a lot about the of this learning outcome?: Graduates demonstrate an 
relevance and need for diversityin appreciation of the constitutional freedoms, legal issues 
mass media and communications. and ethical principles involved in mass communication. 


Timeline for Assessment: annually 





Comprehensive, Certification, or Reporting Period: 2018 - 2019 
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#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications, 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 

Outcome Status: Active 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class, Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved, 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors “exit” 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning and retaining information required in 
the core classes. (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students have an appreciation 
of the constitutional freedoms, legal issues and ethical 
principles involved in mass communication. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the relevance of human diversity in 
mass communications (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning about 
human diversity as they progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the history and social role of mass 
communications (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 
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Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication. 


09/26/2019 


Goal is to score at least 4. 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam, Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class, Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 


How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
invited to participate in the survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students adequately understand 
the history and social role of mass communications 
Reporting Period: 2018 - 2019 

Conclusion: 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised, Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session, 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated a good representation of 
critical, creative and independent thinking as they relate to 
the field of sports media (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 
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Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


09/26/2019 


accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student’s work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

Goal is 4+ 

Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 
survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
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How were students selected to participate in the 
assessment of this outcome?: selected via randomizer,com 
What do the findings suggest about student achievement 
of this learning outcome?: Student portfolios 
demonstrated a good representation of critical, creative 
and independent thinking as they relate to the field of 
sports media 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Internship supervisors said students demonstrated their 
critical, creative and independent as (09/20/2019) 
Number of Students Assessed: 26 

Number of Successful Students: 26 
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Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


rate the work on a 7-point-scale. 
1=Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 6.5 
/7 


Survey - Graduating seniors exit 
survey 

* Learning Outcome 
Goal/Benchmark: 3.85 / 5 
Goal: 4/5 


How were students selected to participate in the 
assessment of this outcome?: Students earning internship 
credit must be evaluated by supervisors 

What do the findings suggest about student achievement 
of this learning outcome?: Students are skilled in critical, 
creative and independent thinking. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students felt their coursework adequately required them to 
demonstrate knowledge of relevant theories and concepts 
of mass communication (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: While students felt positive 
about theories in their coursework, they need more 
exposure to theory. It is recommended that each sequence 
and the entire faculty discuss important theories to 
highlight in multiple classes. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark: Students were 
tested on one question and 
understood the theory 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While students are proficient in identifying theories, more 
theory questions recommended, and faculty should select 
theories to be highlighted in multiple sequence classes, One 
question in the pre-post exam deals with theory. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
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#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering, 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: 5.6 /7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 


in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?:; All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure - many mark it as NA 
instead of giving a rating 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated an average to good 
representation of understanding of the methods and 
techniques used to gather information (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: selected from list of seniors 
using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: External reviewers believe 
students are proficient in information gathering. Note... 
measuring informational gathering skills is difficult. 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





09/26/2019 


portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale, 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1= Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 =Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: 6 / 7 

Goal achieved: 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Prograrn Expectations (Proficient) 
Internship supervisors agree students are adequate in 
research and information gathering skills (09/20/2019) 
Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?: credit internships must have 
supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequate in 
research and information gathering skills, but there's 
always room for improvement. 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale, 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 


Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Reviewers determined that student portfolios were 
generally good in demonstrating an understanding of mass 
communications writing, editing and production techniques 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students; 5 

How were students selected to participate in the 
assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are proficient in 
writing but can do more to showcase their skills - students 
need to include many types of work in their digital 
portfolios. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 
Exam. Students taking the first because the pre-test scores are lower than the post-test 
writing class (Media Style & scores (09/20/2019) 


#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019. 


09/26/2019 


Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100, 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.9/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are adequate in their 
skills and knowledge of planning and management 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Sports Media (BA) - 479 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 

















Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 
Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 


communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 




















* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 

















Outcome: #2 - Relevance of human diversity in mass communications 
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Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 




















* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 
Goal is to score at least 4. 

Timeline for Assessment: annually. 



































Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 











Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 
thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student's work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Goal is 4+ 
Timeline for Assessment: Yearly 




















Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: Goal achieved: 6.5 / 7 








Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 





Survey - Graduating seniors exit survey (Active) 











* Learning Outcome Goal/Benchmark: 3.85 / 5 
Goal: 4/5 


























Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 








* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 











Supervisor Evaluation - Internship supervisor evaluation (Active) 








* Learning Outcome Goal/Benchmark: 5.6 / 7 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 














External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 














Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: 6 / 7 
Goal achieved: 











Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
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Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 








* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 














* Learning Outcome Goal/Benchmark: 3.9 / 5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Science 
Sports Media 





Annual Executive Summary 
Report 


Program (CAS) - SMSC - Sports Media (BS) - 480 











Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, sports media students demonstrated an understanding of the Learning Objectives, demonstrated a good representation 
of critical, creative and independent thinking, and demonstrated an understanding of the writing, editing and production 
techniques. 


Dissemination of Findings 

Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 

Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major’ to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Sports Media (BS) - 480 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 

Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Results represent a good representation of the learning outcome. All faculty should emphasize constitutional freedoms as well as 
relevant legal issues and ethical principles in their courses 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to take an 
exit survey 

What do the findings suggest about student achievement of this learning outcome?: Graduates demonstrate an appreciation of 
the constitutional freedoms, legal issues and ethical principles involved in mass communication. 
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Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students have an appreciation of the 
constitutional freedoms, legal issues and ethical principles involved in mass communication. 














Outcome: #2 - Relevance of human diversity in mass communications 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the relevance of human diversity in mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning about human 
diversity as they progress through the program 

















Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

Goal is to score 4+ 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and social role of mass communications 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were invited to participate 
in the survey 

What do the findings suggest about student achievement of this learning outcome?: Students adequately understand the 
history and social role of mass communications 


























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 
press. 

Timeline for Assessment: annually 








Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 


L 




















Outcome: #4 - Critical, creative and independent thinking in mass 
communication 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

A) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 











(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Goal is 4+ 
Timeline for Assessment: Yearly 
Findings 
Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated a good representation of critical, creative and independent thinking as they relate to the field of 
sports media 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Student portfolios demonstrated a good 
representation of critical, creative and independent thinking as they relate to the field of sports media 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 











Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors said students demonstrated their critical, creative and independent as 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: Students earning internship credit must be 
evaluated by supervisors 

What do the findings suggest about student achievement of this learning outcome?: Students are skilled in critical, creative and 
independent thinking. 











Outcome: #5 - Relevant theories and concepts of mass 
communication 
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Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors exit survey (Active) 
* Learning Outcome Goal/Benchmark: Goal not achieved: 3.85 
Goal is 4+ 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students felt their coursework adequately required them to demonstrate knowledge of relevant theories and concepts of mass 
communication 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: While students felt positive about theories 
in their coursework, they need more exposure to theory. It is recommended that each sequence and the entire faculty discuss 
important theories to highlight in multiple classes. 




















































Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 


Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While students are proficient in identifying theories, more theory questions recommended, and faculty should select theories to 
be highlighted in multiple sequence classes. One question in the pre-post exam deals with theory. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 
























Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: 5.6 /7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure - many mark it as NA instead of giving a rating 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student portfolios demonstrated an average to good representation of understanding of the methods and techniques used to 
gather information 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Note... measuring informational gathering skills is difficult. 























Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: 5.6 / 7 


Findings 
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Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Internship supervisors agree students are adequate in research and information gathering skills 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the assessment of this outcome?: credit internships must have supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: Students are adequate in research and 
information gathering skills, but there's always room for improvement. 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 



























External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Reviewers determined that student portfolios were generally good in demonstrating an understanding of mass communications 
writing, editing and production techniques 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are proficient in writing but can 
do more to showcase their skills - students need to include many types of work in their digital portfolios. 


























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
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times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted, (Active) 
* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.95 / 5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: students are adequate in their skills and 
knowledge of planning and management 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
effective communicators who facilitate and promote participation in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
change through lifelong learning. Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 














Adaptability 
Problem solving skills 
Diversity 
Leadership 
Community involvement 

| Outcomes Assessment Methods Findings Use of Findings (Actions) 
#1 - Understanding constitutional Survey - Graduating seniors were Reporting Period: 2018 - 2019 
freedoms & legal and ethical asked to complete an online "exit" Conclusion: 4 - Exceeds Program Expectations (Advanced) 
principles - Students will demonstrate survey regarding Learning Results represent a good representation of the learning 
an appreciation of the constitutional Outcomes. The survey was givena outcome. All faculty should emphasize constitutional 
freedoms, legal issues and ethical few weeks before graduation. freedoms as well as relevant legal issues and ethical 
principles involved in mass * Learning Outcome principles in their courses (09/20/2019) 
communication. Goal/Benchmark: Goal achieved: 4.4 Number of Students Assessed: 7 
Outcome Status: Active The goal was to receive a mean Number of Successful Students: 7 
Planned Assessment Year: 2018 - score of at least 4 (out of 5) on each How were students selected to participate in the 
2019 question in the senior exit survey, assessment of this outcome?; all graduating seniors were 

which would indicate graduating invited to take an exit survey 


seniors “agree” they understand and What do the findings suggest about student achievement 
have learned a lot about the of this learning outcome?: Graduates demonstrate an 
relevance and need for diversity in appreciation of the constitutional freedoms, legal issues 


mass media and communications, and ethical principles involved in mass communication. 


Timeline for Assessment: annually 








Comprehensive, Certification, or Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications, - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 

Outcome Status: Active 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas, 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes, The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved; 4.1 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4,1 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning information required in the core 
classes, (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students have an appreciation 
of the constitutional freedoms, legal issues and ethical 
principles involved in mass communication. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the relevance of human diversity in 
mass communications (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning about 
human diversity as they progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the history and social role of mass 
communications (09/20/2019) 

Number of Students Assessed; 7 

Number of Successful Students: 7 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication, 


09/26/2019 


Goal is to score 4+ 
Timeline for Assessment: annually, 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced, Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories; 

1) if the student’s work reflected the 
ability to analyze complex situations 


How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
invited to participate in the survey 

What do the findings suggest about student achievement 
of this learning outcome?:; Students adequately understand 
the history and social role of mass communications 
Reporting Period: 2018 - 2019 

Conclusion: 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?; Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated a good representation of 
critical, creative and independent thinking as they relate to 
the field of sports media (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 
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Outcomes 


Assessment Methods Findings Use of Findings (Actions) 





Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


09/26/2019 


How were students selected to participate in the 
assessment of this outcome?: selected via randomizer.com 
What do the findings suggest about student achievement 
of this learning outcome?: Student portfolios 
demonstrated a good representation of critical, creative 
and independent thinking as they relate to the field of 
sports media 


accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student's work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey, Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

Goal is 4+ 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisor Evaluation assessment Conclusion: 4 - Exceeds Program Expectations (Advanced) 
survey (see Appendix) - Internship Internship supervisors said students demonstrated their 
Supervisors were asked to assess the critical, creative and independent as (09/20/2019) 
student's critical, creative and Number of Students Assessed: 26 

independent thinking / work and Number of Successful Students: 26 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


rate the work ona 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 


Survey - Graduating seniors exit 
survey 

* Learning Outcome 
Goal/Benchmark: Goal not 
achieved; 3.85 

Goal is 4+ 


How were students selected to participate in the 
assessment of this outcome?: Students earning internship 
credit must be evaluated by supervisors 

What do the findings suggest about student achievement 
of this learning outcome?: Students are skilled in critical, 
creative and independent thinking. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students felt their coursework adequately required them to 
demonstrate knowledge of relevant theories and concepts 
of mass communication (09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: While students felt positive 
about theories in their coursework, they need more 
exposure to theory. It is recommended that each sequence 
and the entire faculty discuss important theories to 
highlight in multiple classes. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark: Students were 
tested on one question and 
understood the theory 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While students are proficient in identifying theories, more 
theory questions recommended, and faculty should select 
theories to be highlighted in multiple sequence classes, One 
question in the pre-post exam deals with theory. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: 5.6 /7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 


to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students, Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure - many mark it as NA 
instead of giving a rating 


Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student portfolios demonstrated an average to good 
representation of understanding of the methods and 
techniques used to gather information (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: External reviewers believe 
students are proficient in information gathering, Note... 
measuring informational gathering skills is difficult. 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 


reviewer was asked to review the 


student’s work and rate the work on 


a 5-point-scale, 
i= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 /5 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1=Not Applicable 

2 =Understanding Not 
Demonstrated 

3 =Demonstrated Only Slightly 
4=Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: 5.6 / 7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 


demonstrate an understanding of the four categories: 


09/26/2019 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Internship supervisors agree students are adequate in 
research and information gathering skills (09/20/2019) 
Number of Students Assessed; 26 

Number of Successful Students: 26 

How were students selected to participate in the 
assessment of this outcome?: credit internships must have 
supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequate in 
research and information gathering skills, but there's 
always room for improvement. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Reviewers determined that student portfolios were 
generally good in demonstrating an understanding of mass 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 
writing, editing and production 13 communications writing, editing and production techniques 
techniques of mass communication 1) evidence of the ability to write (09/20/2019) 


specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O} 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 


Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are proficient in 
writing but can do more to showcase their skills - students 
need to include many types of work in their digital 
portfolios, 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.95 /5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Generated by Nuventive Improve 


How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed: 7 

Number of Successful Students: 7 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?; students are adequate in their 
skills and knowledge of planning and management 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Sports Media (BS) - 480 











Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 














* Learning Outcome Goal/Benchmark: Goal achieved: 4.4 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 
























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 




















Outcome: #2 - Relevance of human diversity in mass communications 
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Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 






















* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 

Goal is to score 4+ 

Timeline for Assessment: annually. 






























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 





Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 








Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Lae Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 





thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: Goal achieved: 4 / 5 
Goal is 4+ 
Timeline for Assessment: Yearly 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student’s critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors exit survey (Active) 


























* Learning Outcome Goal/Benchmark: Goal not achieved: 3.85 
Goal is 4+ 














Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 





* Learning Outcome Goal/Benchmark: Students were tested on one question and understood the theory 








Supervisor Evaluation - Internship supervisor evaluation (Active) 





* Learning Outcome Goal/Benchmark: 5.6 / 7 


i 








Outcome: #6 - Methods and techniques of research and information 
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gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 














External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 /5 
Timeline for Assessment: Yearly 
































Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 











* Learning Outcome Goal/Benchmark: 5.6 / 7 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
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2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.95 / 5 
Timeline for Assessment: Yearly 























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class, Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 








* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 




















* Learning Outcome Goal/Benchmark: 3.95 /5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 
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Program (CAS) - SMSC - Sports Media (BS) - 480 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity i 

Leadership 

Community involvement 

















|2018 - 2019 
Program Information 


Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 96 

Total Number of Students Graduated: 26 

Number of Student Graduates from Stillwater Campus: 26 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Arts 
Multimedia Journalism 








Program Information Report 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Information 

Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 35 

Total Number of Students Graduated: 6 

Number of Student Graduates from Stillwater Campus: 6 

Were university assessment funds used by the department/program for assessment activities?: Yes 

Number of Student Graduates from Tulsa Campus: 0 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula, One-hundred percent of the selected participants completed the survey. 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/ Benchmark: Goal achieved: 4.3 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning outcome 
Number of Students Assessed: 6 


Number of Successful Students: 6 
How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 



























09/16/2019 


randomizer. com 
What do the findings suggest about student achievement of this learning outcome?: Results indicate a good representation of 


the learning outcome 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning as they progress through the program. 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: graduating seniors required to take the exam in 
capstone class 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program. 



























Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4 /5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they have learned through classes and have an understanding of the relevance of human diversity 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students understand the importance of 
human diversity in mass communications but all faculty should continue to emphasize its importance in each class and each 


sequence 




















Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Seniors agree they have learned about and have a respect for the history and social role of mass communications 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: online survey offered to all graduating seniors 
What do the findings suggest about student achievement of this learning outcome?: students have a good understanding of the 
diversity issues in mass communication 











Comprehensive, Certification, or Professional Exam/(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 





press. 
Timeline for Assessment: annually 
Findings 
Reporting Period: 2018 - 2019 09/16/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning as they progress through the program, and the questions on the test need to better reflect the subject 
matter of core courses. 

Number of Students Assessed: 20 

Number of Successful Students: 16 

How were students selected to participate in the assessment of this outcome?: all students are required to take the post test in 
their capstone class 

What do the findings suggest about student achievement of this learning outcome?: Students are learning...but better testing / 
test questions are needed 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 

1) if the student's work reflected the ability to analyze complex situations accurately (Excel Column D) 

2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 





09/26/2019 Generated by Nuventive Improve Page 3 of 8 





Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.85 125 


Timeline for Assessment: Yearly 





Findings 

Reporting Period: 2018 - 2019 09/16/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated proficiency in critical, creative and independent thinking 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are adequately prepared in 
critical, creative and independent thinking, and there's always room for improvement. Improvement stems from upper-division 
courses requiring assignments that emphasize the importance of critical, creative and independent thinking. 








Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: XX 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Supervisors rated students as proficient to advanced in critical, creative and independent thinking in mass communications 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all credit internships require supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: students are proficiently skilled in critical, 
creative and independent thinking in mass communications 





















Outcome: #5 - Relevant theories and concepts of mass 
communication 
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Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Senior Exit Survey (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1 /5 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student results demonstrate a good representation of the understanding of relevant theories and concepts in mass 
communications 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students have a relevant understanding of 
theories and concepts in mass communications, but more theories should be added to the curriculum 





















Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students! scores on the theory question determined students understood the 





theory 

Timeline for Assessment: annually 
Findings 

Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 


the theories 
Number of Students Assessed: 140 


Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should discuss theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 








Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: xx 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 2 - Meets Minimum Program Expectations (Developing) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure...many mark it as NA instead of giving a rating. This question & measurement need to be reassessed. 
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L 
Outcome: #6 - Methods and techniques of research and information 


gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 




































External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.75 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an understanding of the methods and techniques or research and information gathering 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: Randomly selected from a senior list using 





09/20/2019 


randomizer.com 
What do the findings suggest about student achievement of this learning outcome?: Students demonstrated an understanding 


of the methods and techniques or research and information gathering 








Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: XX 
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Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an adequate understanding of the methods and techniques of research and information gathering. 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all students who earn internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are adequately prepared in the 
areas of research and information gathering 











Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 














Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students adequately demonstrated an understanding of writing, editing and production techniques 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
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courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 
* Learning Outcome Goal/Benchmark: 

Pre assessment score were 76/100. 

Post assessment scores were 83 / 100. 





Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: students are learning, but some 
information seems to be forgotten between sophomore and senior year 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication, 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.7 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: students agree they understand the 
relevant planning and management methods 











09/26/2019 Generated by Nuventive Improve Page 8 of 8 





Program Plan and Findings: Four Column 


Layout 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, 
effective communicators who facilitate and promote participat 
change through lifelong learning. Oklahoma State University Sc 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


ion in a democratic society through excellence in practice, 
hool of Media & Strategic Communications will do this by promoting: 


its neighboring states, the nation and the world to be responsible and 
ethical behavior, a critical stance, and embracing 








Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment; annually 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning 
outcome (09/16/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer. com 

What do the findings suggest about student achievement 
of this learning outcome?: Results indicate a good 
representation of the learning outcome 





Comprehensive, Certification, or 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications, 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications, 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program, (09/16/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: graduating seniors required 
to take the exam in capstone class 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they have learned through classes and have 
an understanding of the relevance of human diversity 
(09/16/2019) 

Number of Students Assessed: 5 

Number of Successful Students; 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students understand the 
importance of human diversity in mass communications but 
all faculty should continue to emphasize its importance in 
each class and each sequence 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Seniors agree they have learned about and have a respect 
for the history and social role of mass communications 
(09/16/2019) 
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| Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 


09/26/2019 


Goal/Benchmark: Goal achieved: 
4/5 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press, 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 


Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: online survey offered to all 
graduating seniors 

What do the findings suggest about student achievement 
of this learning outcome?: students have a good 
understanding of the diversity issues in mass 
communication 

Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program, and the questions on the test need to better 
reflect the subject matter of core courses. (09/16/2019) 
Number of Students Assessed: 20 

Number of Successful Students: 16 

How were students selected to participate in the 
assessment of this outcome?: all students are required to 
take the post test in their capstone class 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning...but 
better testing / test questions are needed 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated proficiency in critical, creative and 
independent thinking (09/16/2019) 
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Outcomes 


~ Assessment Methods 


Findings Use of Findings (Actions) 





independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 
accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student’s work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 


‘Goal/Benchmark: 3.85 / 5 


Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 
survey (see Appendix) - Internship 
Supervisors were asked to assess the 
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Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately 
prepared in critical, creative and independent thinking, and 
there's always room for improvement. Improvement stems 
from upper-division courses requiring assignments that 
emphasize the importance of critical, creative and 
independent thinking. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Supervisors rated students as proficient to advanced in 
critical, creative and independent thinking in mass 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 





student's critical, creative and communications (09/20/2019) 

independent thinking / work and Number of Students Assessed: 13 

rate the work on a 7-point-scale. Number of Successful Students: 13 

1 = Not Applicable How were students selected to participate in the 

2 = Understanding Not assessment of this outcome?; all credit internships require 
Demonstrated supervisor evaluations 

3 = Demonstrated Only Slightly What do the findings suggest about student achievement 
4 = Demonstrated Occasionally of this learning outcome?: students are proficiently skilled 
5 = Demonstrated But Needs Work in critical, creative and independent thinking in mass 

6 = Demonstrated Well communications 


7 = Expertly Demonstrated 
* Learning Outcome 
Goal/Benchmark: XX 


#5 - Relevant theories and concepts Survey - Graduating Senior Exit Reporting Period: 2018 - 2019 

of mass communication-Students Survey Conclusion: 3 - Meets Program Expectations (Proficient) 
will demonstrate an understanding of * Learning Outcome Student results demonstrate a good representation of the 
the relevant theories and concepts of Goal/Benchmark: Goal achieved: 4.1 understanding of relevant theories and concepts in mass 
mass communication. 1/5 communications (09/20/2019) 

Outcome Status: Active Number of Students Assessed: 6 

Planned Assessment Year: 2018 - Number of Successful Students: 6 

2019 How were students selected to participate in the 


assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a relevant 
understanding of theories and concepts in mass 
communications, but more theories should be added to the 
curriculum 


Comprehensive, Certification, or Reporting Period: 2018 - 2019 

Professional Exam(s) - Pre-post core Conclusion: 3 - Meets Program Expectations (Proficient) 

curriculum exam One question in the pre-post exam deals with theory - more 

* Learning Outcome questions should be added - faculty should focus on classes 

Goal/Benchmark: Students' scores covering the theories (09/20/2019) 

on the theory question determined Number of Students Assessed: 140 

students understood the theory Number of Successful Students: 140 

Timeline for Assessment: annually How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 
What do the findings suggest about student achievement 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: xx 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 


of this learning outcome?: faculty should discuss theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...many mark it as NA 
instead of giving a rating. This question & measurement 
need to be reassessed. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an understanding of the methods 
and techniques or research and information gathering 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: Randomly selected froma 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrated an 
understanding of the methods and techniques or research 
and information gathering 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#7 - Writing, editing and production 


09/26/2019 


portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale. 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.75 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
- a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


Portfolio Review - In the External 
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Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students demonstrated an adequate understanding of the 
methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students who earn 
internship credit are required to have a supervisor 
evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are adequately 
prepared in the areas of research and information 
gathering 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students adequately demonstrated an understanding of 
writing, editing and production techniques (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected froma 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the “core curriculum” material 
because the pre-test scores are lower than the post-test 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions) 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas, 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: 

Pre assessment score were 76/100. 
Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.7 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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scores (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning, but some 
information seems to be forgotten between sophomore 
and senior year 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed; 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students agree they understand 
the relevant planning and management methods 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4.3 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 





* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 





Outcome: #2 - Relevance of human diversity in mass communications 
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Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was givena 
few weeks before graduation. (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 





Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: annually. 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 

(questions 42-50) with an average of 62%. 





Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 


thinking) is assessed in four categories: 
1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
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2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 
3) if the student’s work reflected looking beyond the obvious (Excel Column F) 
A) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student's work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

A= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.85 / 5 





Timeline for Assessment: Yearly 








Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student’s critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: XX 





Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Senior Exit Survey (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 








Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/ Benchmark: Students' scores on the theory question determined students understood the theory 
Timeline for Assessment: annually 











Supervisor Evaluation - Internship supervisor evaluation (Active) 





* Learning Outcome Goal/Benchmark: xx 
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Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column |) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.75 
Timeline for Assessment: Yearly 











Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: XX 





Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


09/26/2019 Generated by Nuventive Improve Page 4 of 5 





Program (CAS) - SMSC - Multimedia Journalism (BA) - 478 








Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 


External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 


via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 





* Learning Outcome Goal/Benchmark: 
Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 








* Learning Outcome Goal/Benchmark: 3.7 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 





The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recom mend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum, 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to bea 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, multimedia journalism students demonstrated an understanding of the Learning Objectives, demonstrated proficiency 
in critical, creative and independent thinking, and demonstrated an understanding of the writing, editing, information gathering 


and production techniques. 


Dissemination of Findings 


Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 
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Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. Bobbikay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 

Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major' to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School, 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Information 
Assessment Coordinator's Name: Gina Noble 


Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 56 

Total Number of Students Graduated: 10 

Number of Student Graduates from Stillwater Campus: 10 

Were university assessment funds used by the department/program for assessment activities?: Yes 


Number of Student Graduates from Tulsa Campus: 0 
If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 


SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic commu nications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation ina democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members’ interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Overall, multimedia journalism students demonstrated an understanding of the Learning Objectives, demonstrated proficiency 
in critical, creative and independent thinking, and demonstrated an understanding of the writing, editing, information gathering 


and production techniques. 


Dissemination of Findings 


Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 


sequence head for Sports Media 
Dr. Joey Senat - sequence head for Multimedia Journalism 
Dr, BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major' to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Results indicate a good representation of the learning outcome 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer. com 

What do the findings suggest about student achievement of this learning outcome?: Results indicate a good representation of 
the learning outcome 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students | 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning as they progress through the program. 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: required exam for all capstone students 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program. 

















Outcome: #2 - Relevance of human diversity in mass communications 
Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications, 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Results demonstrate a good representation of understanding of the relevance of human diversity in mass communications 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students understand the importance of 
human diversity in mass communications but all faculty should continue to emphasize its importance in each class and each 
sequence 























Outcome: #3 - History and social role of mass communications. 
Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Results demonstrate a good representation of students' respect for the history and social role of mass communications. All 
faculty should emphasize the importance of history and social role in their classes. The social role can be emphasized through in- 
class speakers, etc. 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students have a good understanding 
regarding the history and social role of mass communication. 


























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 
press. 

Timeline for Assessment: annually 





Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included and emphasized in all or 
most upper-division classes 








Outcome: #4 - Critical, creative and independent thinking in mass 
communication 
Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


| Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
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independent thinking) is assessed in four categories: 

1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

A= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.85 / 5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated proficiency in critical, creative and independent thinking 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students are adequately prepared in 
critical, creative and independent thinking, and there's always room for improvement. Improvement stems from upper-division 
courses requiring assignments that emphasize the importance of critical, creative and independent thinking. 











Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student’s critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/ Benchmark: XX 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Supervisors rated students as proficient to advanced in critical, creative and independent thinking in mass com munications 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all credit internships required supervisor 
evaluations 

What do the findings suggest about student achievement of this learning outcome?: students are proficiently skilled in critical, 
creative and independent thinking in mass communications 








Outcome: #5 - Relevant theories and concepts of mass 
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communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Senior Exit Survey (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Student results demonstrate a good representation of the understanding of relevant theories and concepts in mass 
communications 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the assessment of this outcome?: seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students have a relevant understanding of 
theories and concepts in mass communications, but more theories should be added to the curriculum. 




















Comprehensive, Certification, or Professional Exam(s) - Pre-post core curriculum exam (Active) 
* Learning Outcome Goal/Benchmark: Students' scores on the theory question determined students understood the 





theory 

Timeline for Assessment: annually 
Findings 

Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 3 - Meets Program Expectations (Proficient) 

One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 
the theories 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 
capstone class and all students enrolled in Media Style & Structure 

What do the findings suggest about student achievement of this learning outcome?: faculty should discuss theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 














Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: xx 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 2 - Meets Minimum Program Expectations (Developing) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to 
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something they usually don't measure...many mark it as NA instead of giving a rating. This question & measurement need to be 
reassessed. 





Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column |) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.75 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an understanding of the methods and techniques or research and information gathering 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: Randomly selected from a senior list using 
randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students demonstrated an understanding 
of the methods and techniques or research and information gathering 











Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 
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* Learning Outcome Goal/Benchmark: XX 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students demonstrated an adequate understanding of the methods and techniques of research and information gathering. 
Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the assessment of this outcome?: all students who earn internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are adequately prepared in the 
areas of research and information gathering 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

A= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students adequately demonstrated an understanding of writing, editing and production techniques 

Number of Students Assessed: 5 


Number of Successful Students: 5 
How were students selected to participate in the assessment of this outcome?: randomly selected from a senior list using 





randomizer.com 
What do the findings suggest about student achievement of this learning outcome?: Students demonstrate adequate 


knowledge in writing, editing and production 








| Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students | 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 









For LO #7, questions 1-20 were counted. (Active) 
* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 














Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: 3.7 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: all seniors were invited to participate in an exit 
survey 

What do the findings suggest about student achievement of this learning outcome?: Students agree they understand the 
relevant planning and management methods 
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Program Mission Statement: To educate 
effective communicators who facilitate and promote participation 
change through lifelong learning. Oklahoma State University Schoo 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
| of Media & Strategic Communications will do this by promoting: 








| Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication, 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment; annually 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning 
outcome (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer. com 

What do the findings suggest about student achievement 
of this learning outcome?: Results indicate a good 
representation of the learning outcome 








Comprehensive, Certification, or 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program. (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required exam for all 
capstone students 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of 
understanding of the relevance of human diversity in mass 
communications (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students understand the 
importance of human diversity in mass communications but 
all faculty should continue to emphasize its importance in 
each class and each sequence 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of students’ 
respect for the history and social role of mass 
communications. All faculty should emphasize the 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 








Outcome Status: Active 
Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 


09/26/2019 


Goal/Benchmark: Goal achieved: 
4/5 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%, 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
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importance of history and social role in their classes. The 
social role can be emphasized through in-class speakers, 
etc. (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a good 
understanding regarding the history and social role of mass 
communication. 

Reporting Period: 2018 - 2019 

Conclusion; 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?; Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
and emphasized in all or most upper-division classes 


Reporting Period: 2018 - 2019 
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Assessment Methods 


Findings Use of Findings (Actions)| 





independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 
accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student's work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.85 / 5 
Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated proficiency in critical, creative and 
independent thinking (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately 
prepared in critical, creative and independent thinking, and 
there's always room for improvement. Improvement stems 
from upper-division courses requiring assignments that 
emphasize the importance of critical, creative and 
independent thinking. 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


Survey - Graduating Senior Exit 
Survey 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 
/5 


Supervisors rated students as proficient to advanced in 
critical, creative and independent thinking in mass 
communications (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all credit internships 
required supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: students are proficiently skilled 
in critical, creative and independent thinking in mass 
communications 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student results demonstrate a good representation of the 
understanding of relevant theories and concepts in mass 
communications (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate inthe 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a relevant 
understanding of theories and concepts in mass 
communications, but more theories should be added to the 
curriculum. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark: Students’ scores 
on the theory question determined 
students understood the theory 
Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more 
questions should be added - faculty should focus on classes 
covering the theories (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#6- Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Supervisor Evaluation - Internship 
supervisor evaluation 

* Learning Outcome 
Goal/Benchmark: xx 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 

2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 
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in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should discuss theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period; 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say “theories” are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...many mark it as NA 
instead of giving a rating. This question & measurement 
need to be reassessed. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an understanding of the methods 
and techniques or research and information gathering 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: Randomly selected froma 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrated an 
understanding of the methods and techniques or research 
and information gathering 
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Findings 


Use of Findings (Actions)| 





External reviewers reviewed five 
portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale. 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.75 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
- a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an adequate understanding of the 
methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students who earn 
internship credit are required to have a supervisor 
evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are adequately 
prepared in the areas of research and information 


7 = Expertly Demonstrated gathering 
* Learning Outcome 
Goal/Benchmark: XX 
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#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column 0) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.9 
Timeline for Assessment: Yearly 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students adequately demonstrated an understanding of 
writing, editing and production techniques (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 


Reporting Period: 2018 - 2019 
Conclusion; 3 - Meets Program Expectations (Proficient) 
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Findings Use of Findings (Actions) 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication, 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students In 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and Is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark; 3.7 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 
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Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication. 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students agree they understand 
the relevant planning and management methods 
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Program Mission Statement: To educat 
effective communicators who facilitate and promote parti 
change through lifelong learning. Oklahoma State Universi 


Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 
Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 


e the future leaders in mass communication from Oklahoma, 
cipation in a democratic society through excellence in practice, 
ty School of Media & Strategic Communications will do this by promoting: 


its neighboring states, the nation and the world to be responsible and 
ethical behavior, a critical stance, and embracing 








Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.3 
The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results indicate a good representation of the learning 
outcome (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this autcome?: randomly selected from a 
senior list using randomizer. com 

What do the findings suggest about student achievement 
of this learning outcome?; Results indicate a good 
representation of the learning outcome 





Comprehensive, Certification, or 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 








#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 
communications. 


09/26/2019 


Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 

* Learning Outcome 
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Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning as they progress through the 
program. (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required exam for all 
capstone students 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program, 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of 
understanding of the relevance of human diversity in mass 
communications (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?; all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students understand the 
importance of human diversity in mass communications but 
all faculty should continue to emphasize its importance in 
each class and each sequence 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Results demonstrate a good representation of students’ 
respect for the history and social role of mass 
communications. Alll faculty should emphasize the 
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Outcomes 





Assessment Methods 


Findings Use of Findings (Actions) 





Outcome Status; Active 
Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 


09/26/2019 


Goal/Benchmark: Goal achieved: 
4/5 
Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 


importance of history and social role in their classes. The 
social role can be emphasized through in-class speakers, 
etc. (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a good 
understanding regarding the history and social role of mass 
communication. 

Reporting Period: 2018 - 2019 

Conclusion: 1- Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too "trivial" in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
and emphasized in all or most upper-division classes 


Reporting Period: 2018 - 2019 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions)| 





independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 
independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
is assessed in four categories: 

1) if the student’s work reflected the 
ability to analyze complex situations 
accurately (Excel Column D) 

2) if the student was able to craft 
innovative solutions to difficult 
problems (Excel Column E) 

3) if the student's work reflected 
looking beyond the obvious (Excel 
Column F) 

4) if the student had the ability to 
effectively communicate complex 
ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student’s work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.85 / 5 
Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisor Evaluation assessment 


Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated proficiency in critical, creative and 
independent thinking (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately 
prepared in critical, creative and independent thinking, and 
there's always room for improvement. Improvement stems 
from upper-division courses requiring assignments that 
emphasize the importance of critical, creative and 
independent thinking. 


Reporting Period: 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
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| Outcomes 


Assessment Methods 


Findings l Use of Findings (Actions) 








#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
rate the work ona 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


Survey - Graduating Senior Exit 
Survey 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.1 


/5 


Supervisors rated students as proficient to advanced in 
critical, creative and independent thinking in mass 
communications (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all credit internships 
required supervisor evaluations 

What do the findings suggest about student achievement 
of this learning outcome?: students are proficiently skilled 
in critical, creative and independent thinking in mass 
communications 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Student results demonstrate a good representation of the 
understanding of relevant theories and concepts in mass 
communications (09/20/2019) 

Number of Students Assessed: 6 

Number of Successful Students: 6 

How were students selected to participate in the 
assessment of this outcome?: seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students have a relevant 
understanding of theories and concepts in mass 
communications, but more theories should be added to the 
curriculum. 





Comprehensive, Certification, or 
Professional Exam(s) - Pre-post core 
curriculum exam 

* Learning Outcome 
Goal/Benchmark; Students’ scores 
on the theory question determined 
students understood the theory 
Timeline for Assessment: annually 





Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more 
questions should be added - faculty should focus on classes 
covering the theories (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
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Outcomes Assessment Methods 


Findings 


Use of Findings (Actions)| 





Supervisor Evaluation - Internship 
supervisor evaluation 
* Learning Outcome 


Goal/Benchmark: xx 
#6- Methods and techniques of Portfolio Review - In the External 
research and information gathering - Reviewers Portfolio assessment, 
Students will demonstrate an Learning Outcome #6 assessed if the 
understanding of the methods and students’ work showed evidence for 
techniques of research and 1) the ability to gather information 
information gathering. effectively and competently (Excel 
Outcome Status: Active Column H) 
Planned Assessment Year: 2018 - 2) initiative and creativity in 
2019 information gathering (Excel Column 


1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should discuss theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students, Where else can this outcome be measured? 
(09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...many mark it as NA 
instead of giving a rating. This question & measurement 
need to be reassessed. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an understanding of the methods 
and techniques or research and information gathering 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: Randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrated an 
understanding of the methods and techniques or research 
and information gathering 
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Outcomes Assessment Methods 


Findings Use of Findings (Actions)| 





External reviewers reviewed five 
portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale, 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: 3.75 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
- a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: XX 


09/26/2019 
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Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students demonstrated an adequate understanding of the 
methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 13 

Number of Successful Students: 13 

How were students selected to participate in the 
assessment of this outcome?: all students who earn 
internship credit are required to have a supervisor 


evaluation 
What do the findings suggest about student achievement 


of this learning outcome?: students are adequately 
prepared in the areas of research and information 
gathering 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year; 2018 - 
2019 


09/26/2019 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column 0) 


External reviewers reviewed 8 
portfolios and received two links; 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student’s work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark; 3.9 
Timeline for Assessment: Yearly 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students adequately demonstrated an understanding of 
writing, editing and production techniques (09/20/2019) 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: randomly selected from a 
senior list using randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students demonstrate adequate 
knowledge in writing, editing and production 





Reporting Period; 2018 - 2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 
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Assessment Methods 


Findings 


Use of Findings (Actions)| 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class, Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times, The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100, 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation, 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: 3.7 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 120 

Number of Successful Students: 120 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students agree they understand the relevant planning and 
management methods in mass communication, 
(09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: all seniors were invited to 
participate in an exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students agree they understand 
the relevant planning and management methods 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Arts 
Strategic Communication 





Program Information Report 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Information 

Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 68 

Total Number of Students Graduated: 19 

Number of Student Graduates from Stillwater Campus: 19 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jabs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2021 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members’ interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to bea 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media. Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society. 
This also indicates that the curriculum should include more emphasis on the social role of mass comm/media through course 
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content readings, class discussions, assignments and in-class speakers, The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 


















Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 


In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world. Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


The 2018-19 SMSC Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i,e., 62 vs. 
74 percent). However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements 
in three of the four core courses, Those scores indicate students are learning many key concepts. In contrast, averages related to 
Media in a Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the 
pretest. However, this was only the second time both tests were administered in the same academic year so making any 
statement about the overarching effectiveness of teaching based on test results is difficult. 





The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media. Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society, 
This also indicates that the curriculum should include more emphasis on the social role of mass comm/media through course 
content readings, class discussions, assignments and in-class speakers. The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 





Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 





In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world. Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


Overall, strategic communication students demonstrate a good to outstanding understanding of the Learning objectives, critical 
and creative thinking and writing and editing techniques. 


Dissemination of Findings 


Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 


sequence head for Sports Media 
Dr. Joey Senat - sequence head for Multimedia Journalism 
Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: Sequence heads, program director 
and associate director send results to all faculty members then discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major' to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes in assessment 
measures other than we will have fewer external reviewers assessing each sequence because funding was cut by half this year. 
Our external reviewers review student portfolios, which is the most important assessment measure for our School. 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Improved Faculty Understanding or Buy-In 
Goals for the Coming Year: Sequence heads will replace some pre-post test questions to better reflect core curriculum ; 
internship supervisor question discussed and possibly eliminated (learning outcome #5). Continued faculty buy-in and increased 
awareness of all assessment measures 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 





09/26/2019 Generated by Nuventive Improve Page 3 of 3 





Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Graduating seniors agreed strongly to understanding constitutional freedoms & legal and ethical principles 

Number of Students Assessed: 34 

Number of Successful Students: 34 

How were students selected to participate in the assessment of this outcome?: every graduating senior was invited to 
participate in an online survey 

What do the findings suggest about student achievement of this learning outcome?: Students are learning and retaining 
constitutional freedoms & legal and ethical principles information 

















i Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program 








| 
Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 





Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online “exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: 4.3 /5 
Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, 
which would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for 
diversity in mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are confident in their learning of human diversity in mass communication 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 
through the program 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role. (Active) 

* Learning Outcome Goal/Benchmark: 4 /5 

Goal achieved. 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and role of mass communication, but this is one area where measurement could be expanded. 
Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 
in an online exit survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 


through the program. 















Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 





press. 
Timeline for Assessment: annually 
Findings 
Reporting Period: 2018 - 2019 09/20/2019 


Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 86 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 

Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 
Outcome Status: Active 


Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student's work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student's work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers agree students are demonstrating critical, creative and independent thinking in mass communication. 
However, this is hard to access in some digital artifacts. What else can be done to measure creative and independent thinking? 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students proficiently demonstrate critical, 
creative and independent thinking in mass communication 











Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors agreed strongly that students’ perform well in critical, creative and independent thinking in mass 
communication 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: students enrolled in internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are meeting and exceeding 
professionals expectations regarding critical, creative and independent thinking in mass communication 











Outcome: #5 - Relevant theories and concepts of mass 


09/26/2019 Generated by Nuventive Improve Page 4 of 8 





Program (CAS) - SMSC - Strategic Communication (BA) - 476 





communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Seniors Exit Survey (Active) 


* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 


mass media and communications. 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

Seniors agree they understand the relevant theories and concepts of mass communication 
Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 
in an online exit survey 

What do the findings suggest about student achievement of this learning outcome?: students are exposed to and learning 
relevant communication theories, but more could be done by faculty to focus on which theories are presented in which classes to 


expose the students to same theories across the program 













09/20/2019 








Comprehensive, Certification, or Professional Exam(s) - Pre and post test (Active) 
* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication theory 














Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 
the theories 

Number of Students Assessed: 140 


Number of Successful Students: 140 
How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 


capstone class and all students enrolled in Media Style & Structure 
What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 
in subsequent classes / more questions written for theory on pre-post exam 


09/20/2019 








Supervisor Evaluation - Internship supervisor evaluation (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - 
meaning theories were not a part of the learning achieved through internship. 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations (Developing) 
While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 


"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 41 

Number of Successful Students: 41 








09/20/2019 
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How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 


required to receive an internship supervisor evaluation 
What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 


they usually don't measure...and rating students well 





Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 

Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 








External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers believe students have skills pertaining to information gathering 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: From a graduating senior student list, five 
seniors were selected randomly via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Plus, measuring informational gathering skills is difficult. 





09/20/2019 








Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
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6 = Demonstrated Well 
7 = Expertly Demonstrated (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Internship supervisors agree students are well equipped with research and information gathering skills 


Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: Required for all credit internships 
What do the findings suggest about student achievement of this learning outcome?: Students are skilled in information 
gathering and other research skills 

















Outcome: #7 - Writing, editing and procucnon techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey, Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 





(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4 / 5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are proficient in writing but can do more to showcase their skills - students need to include many types of work in their 
digital portfolios. 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: sample selected from randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students have proficient writing skills but 
need to showcase them across more platforms and in different ways. Students should have a lot of samples in their portfolios. 
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Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class, Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 










For LO #7, questions 1-20 were counted. (Active) 


* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100, 








Findings 
Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 








Outcome: #8 = Relevant planning and management methods in mass 
communication 

Students will demonstrate an understanding of relevant planning and management methods in mass Zanamhunteation. 

Outcome Status: Active 


Planned Assessment Year: 2018 - 2019 


Assessment Methods 











Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Students strongly agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online "exit" survey 

What do the findings suggest about student achievement of this learning outcome?: students are comfortable in their skills and 
knowledge of planning and management 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the nation and the world to be responsible and 
effective communicators who facilitate and promote participation in a democratic society through excellence in practice, ethical behavior, a critical stance, and embracing 
change through lifelong learning. Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











Outcomes Assessment Methods Findings Use of Findings (Actions) 
#1 - Understanding constitutional Survey - Graduating seniors were Reporting Period: 2018 - 2019 
freedoms & legal and ethical asked to complete an online “exit” Conclusion: 4 - Exceeds Program Expectations (Advanced) 
principles - Students will demonstrate survey regarding Learning Graduating seniors agreed strongly to understanding 
an appreciation of the constitutional Outcomes. The survey was given a constitutional freedoms & legal and ethical principles 
freedoms, legal issues and ethical few weeks before graduation. (09/20/2019) 
principles involved in mass * Learning Outcome Number of Students Assessed: 34 
communication. Goal/Benchmark: Goal achieved: 4.6 Number of Successful Students: 34 
Outcome Status: Active /5 How were students selected to participate in the 
Planned Assessment Year: 2018 - The goal was to receive a mean assessment of this outcome?: every graduating senior was 
2019 score of at least 4 (out of 5) on each invited to participate in an online survey 
question in the senior exit survey, What do the findings suggest about student achievement 
which would indicate graduating of this learning outcome?: Students are learning and 
seniors “agree” they understand and retaining constitutional freedoms & legal and ethical 
have learned a lot about the principles information 


relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 
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Assessment Methods 


Findings 


Use of Findings (Actions) 





#2 - Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 


09/26/2019 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was givena 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark; 4.3 / 5 

Goal achieved. The goal was to 
receive a mean score of at least 4 
(out of 5) on each question in the 
senior exit survey, which would 
indicate graduating seniors “agree” 
they understand and have learned a 
lot about the relevance and need for 
diversity in mass media and 
communications, 

Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation, Question #3 measured 
history and social role. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning information required in the core 
classes. (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are confident in their learning of human diversity 
in mass communication (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students; 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students understand the history and role of mass 
communication, but this is one area where measurement 
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Assessment Methods 


Findings Use of Findings (Actions) 





communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#4 - Critical, creative and 
independent thinking in mass 
communication - Students will 
demonstrate critical, creative and 


09/26/2019 


* Learning Outcome 
Goal/Benchmark: 4/5 

Goal achieved. 

Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class, 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


Many questions were deemed trivia 
by the committee, and questions 
need to be replaced. Questions need 
to better reflect assessing student 
learning in key areas under the 
history of mass communications and 
the importance of a free press. 
Timeline for Assessment: annually 


Portfolio Review - In the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 


could be expanded. (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
asked to participate in an online exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program. 

Reporting Period: 2018 - 2019 

Conclusion: 1 - Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too “trivial” in nature by the committee. 
Questions must be replaced before the next testing session. 
(09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 86 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
External reviewers agree students are demonstrating 
critical, creative and independent thinking in mass 
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independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


is assessed in four categories: communication, However, this is hard to access in some 
1) if the student's work reflected the digital artifacts. What else can be done to measure creative 
ability to analyze complex situations and independent thinking? (09/20/2019) 


accurately (Excel Column D) Number of Students Assessed; 5 

2) if the student was able to craft Number of Successful Students: 5 

innovative solutions to difficult How were students selected to participate in the 
problems (Excel Column E) assessment of this outcome?: randomly selected via 

3) if the student's work reflected randomizer.com 

looking beyond the obvious (Excel What do the findings suggest about student achievement 
Column F) of this learning outcome?: Students proficiently 

4) if the student had the ability to demonstrate critical, creative and independent thinking in 
effectively communicate complex mass communication 


ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Gval/Benchmark: Goal achieved - 
4.2 out of five, which exceeds the 
goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship Reporting Period: 2018 - 2019 
Supervisor Evaluation assessment Conclusion: 4 - Exceeds Program Expectations (Advanced) 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#5 - Relevant theories and concepts 
of mass communication - Students 
will demonstrate an understanding of 
the relevant theories and concepts of 
mass communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey (see Appendix) - Internship 
Supervisors were asked to assess the 
student's critical, creative and 
independent thinking / work and 
rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: The average 
ranking was 6.3 / 7, which exceeds 
the goal of 6. 


Survey - Graduating Seniors Exit 
Survey 

* Learning Outcome 
Goal/Benchmark:; Goal achieved - 
4.2/5. 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 


Internship supervisors agreed strongly that students' 
perform well in critical, creative and independent thinking 
in mass communication (09/20/2019) 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: students enrolled in 
internship credit are required to have a supervisor 
evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are meeting and 
exceeding professionals expectations regarding critical, 
creative and independent thinking in mass communication 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Seniors agree they understand the relevant theories and 
concepts of mass communication (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
asked to participate in an online exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are exposed to and 
learning relevant communication theories, but more could 
be done by faculty to focus on which theories are presented 
in which classes to expose the students to same theories 
across the program 





Comprehensive, Certification, or 
Professional Exam(s) - Pre and post 
test 

* Learning Outcome 
Goal/Benchmark: Posttest scores 
demonstrated an understanding of 
the mass communication theory 


Reporting Period: 2018 - 2019 i 
Conclusion: 3 - Meets Program Expectations (Proficient) 
One question in the pre-post exam deals with theory - more 
questions should be added - faculty should focus on classes 
covering the theories (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
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Outcomes Assessment Methods Findings Use of Findings (Actions) | 


assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 
What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Supervisor Evaluation - Internship Reporting Period: 2018 - 2019 





supervisor evaluation Conclusion: 2 - Meets Minimum Program Expectations 
* Learning Outcome (Developing) 

Goal/Benchmark: Goal achieved-6 While the internship supervisor's rated students as 

out of 7. Many supervisor achieving the goal, the measurement could be stronger. 


evaluations stated "not applicable"- | Most supervisors say "theories" are not applicable to the 
meaning theories were not a part of internship job - they are just checking a box to help the 
the learning achieved through students, Where else can this outcome be measured? 
internship. (09/20/2019) 
Number of Students Assessed: 41 
Number of Successful Students: 41 
How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 
What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure...and rating students 


well 

#6 - Methods and techniques of Portfolio Review - In the External Reporting Period: 2018 - 2019 
research and information gathering- Reviewers Portfolio assessment, Conclusion: 3 - Meets Program Expectations (Proficient) 
Students will demonstrate an Learning Outcome #6 assessed ifthe External reviewers believe students have skills pertaining to 
understanding of the methods and students’ work showed evidence for information gathering (09/20/2019) 
techniques of research and 1) the ability to gather information Number of Students Assessed: 5 
information gathering. effectively and competently (Excel © Number of Successful Students: 5 
Outcome Status: Active Column H) How were students selected to participate in the 
Planned Assessment Year: 2018 - 2) initiative and creativity in assessment of this outcome?: From a graduating senior 
2019 information gathering (Excel Column student list, five seniors were selected randomly via 

1) randomizer.com 

3) use multiple methods and sources What do the findings suggest about student achievement 

for research (Excel Column J) of this learning outcome?: External reviewers believe 


4) to effectively communicate how students are proficient in information gathering. Plus, 
the information was gathered (Excel measuring informational gathering skills is difficult. 
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Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





09/26/2019 


Column K) 


External reviewers reviewed five 
portfolios and received two links: 1) 


a link to a student portfolio, and 2) a 


link to an online survey. Each 
reviewer was asked to review the 


student's work and rate the work on 


a 5-point-scale. 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4.1/5 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 


Reporting Period; 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Internship supervisors agree students are well equipped 
with research and information gathering skills (09/20/2019) 
Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: Required for all credit 
internships d 

What do the findings suggest about student achievement 
of this learning outcome?: Students are skilled in 
information gathering and other research skills 
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Assessment Methods 


Findings Use of Findings (Actions)| 








#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


* Learning Outcome 
Goal/Benchmark: Goal achieved - 
6.2 out of 7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale. 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 


Goal/Benchmark: Goal achieved: 4 / 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are proficient in writing but can do more to 
showcase their skills - students need to include many types 
of work in their digital portfolios. (09/20/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome? sample selected from 
randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students have proficient writing 
skills but need to showcase them across more platforms 
and in different ways. Students should have a lot of samples 
in their portfolios. 


Page 8 of 10 








Outcomes 


Assessment Methods 


Findings Use of Findings (Actions)| 





#8 = Relevant planning and 
management methods in mass 
communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication. 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


5 

Timeline for Assessment: Yearly 
Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.6 
[Ss 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/20/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year. 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Students strongly agree they understand the relevant 
planning and management methods in mass 
communication. (09/20/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online "exit" survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are comfortable in 
their skills and knowledge of planning and management 
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| Outcomes Assessment Methods Findings Use of Findings (Actions) 


mass media and communications. 
Timeline for Assessment: Yearly 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was givena 
few weeks before graduation. (Active) 













* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 /5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 
Timeline for Assessment: annually 








Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking | 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 











Outcome: #2 - Relevance of human diversity in mass communications 
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Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 
























* Learning Outcome Goal/Benchmark: 4.3 /5 
Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which 
would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 





Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications, 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 
* Learning Outcome Goal/Benchmark: 4/5 
Goal achieved. 
Timeline for Assessment: annually. 





























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 

(questions 42-50) with an average of 62%. 





Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 


Timeline for Assessment: annually 











Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 








thinking) is assessed in four categories: 
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Program (CAS) - SMSC - Strategic Communication (BA) - 476 








1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student's work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 





Timeline for Assessment: Yearly 








Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student's critical, creative and independent thinking / work and rate the work ona 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 


* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 








Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating Seniors Exit Survey (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 








Comprehensive, Certification, or Professional Exam(s) - Pre and post test (Active) 





* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication theory 








Supervisor Evaluation - Internship supervisor evaluation (Active) ] 
* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - 
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Program (CAS) - SMSC - Strategic Communication (BA) - 476 





| meaning theories were not a part of the learning achieved through internship. | 





Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 
1) the ability to gather information effectively and competently (Excel Column H) 
2) initiative and creativity in information gathering (Excel Column I) 
3) use multiple methods and sources for research (Excel Column J) 
4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 











Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 





Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Program (CAS) - SMSC - Strategic Communication (BA) - 476 





Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: Yearly 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 





* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was givena 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 








* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 
Timeline for Assessment: Yearly 
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2018 — 2019 
Annual Assessment Report 


Bachelor of Science 
Strategic Communication 





Program Information Report 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 
Program Information 


Assessment Coordinator's Name: Gina Noble 

Assessment Coordinator's E-mail Address: gina.noble@okstate.edu 

Number of Students Enrolled in the Program: 182 

Total Number of Students Graduated: 76 

Number of Student Graduates from Stillwater Campus: 76 

Number of Student Graduates from Tulsa Campus: 0 

Were university assessment funds used by the department/program for assessment activities?: Yes 

If yes, describe how funds were used and the contribution the funds had on the assessment process: Funds were used to pay 
SMSC alumni to assess student digital portfolios. SMSC selected and paid alumni who had been working professionally at least 
three-to-five years (or more) in media, sports media and strategic communications (representative of SMSC’s three programs). 
The funds helped legitimize the importance of SMSC’s assessment research to participating alumni because they took their jobs 
seriously and gave in-depth answers to help us better understand our students’ strengths and weaknesses, which helps faculty 
improve curricula. One-hundred percent of the selected participants completed the survey. 
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Annual Executive Summary 
Report 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 





Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 








2018 - 2019 


Program Assessment Coordinator: Gina Noble 

Plan Review and Approval 

Date Current Plan Was Reviewed and Approved: 09/20/2019 

Date of Future Plan Review and Approval: 08/28/2020 

Summary of Assessment Findings 

Describe overall assessment findings and faculty members' interpretation of the assessment results: The 2018-19 SMSC 
Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 74 percent). 
However, the averages were higher than the previous year’s scores (50 vs. 67 percent) and showed improvements in three of the 
four core courses. Those scores indicate students are learning many key concepts, In contrast, averages related to Media ina 
Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the pretest. 
However, this was only the second time both tests were administered in the same academic year so making any statement 
about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to be a 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know. 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media. Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society. 
This also indicates that the curriculum should include more emphasis on the social role of mass comm/media through course 
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content readings, class discussions, assignments and in-class speakers. The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 


Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 


In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world. Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


The 2018-19 SMSC Assessment Committee finds the overall averages for the pretest vs. posttest were relatively low (i.e., 62 vs. 
74 percent). However, the averages were higher than the previous year's scores (50 vs. 67 percent) and showed improvements 
in three of the four core courses. Those scores indicate students are learning many key concepts. In contrast, averages related to 
Media in a Diverse Society did not improve substantially and, for some questions, the posttest averages were lower than for the 
pretest. However, this was only the second time both tests were administered in the same academic year so making any 
statement about the overarching effectiveness of teaching based on test results is difficult. 


The committee notes that student scores can be affected by the time between taking a core course and taking the posttest. Also 
unaccounted for are students, including transfers, who take core courses elsewhere. To help address the latter, we recommend 

starting next year, SMSC use CWIDs to track scores of the same cohort that took the pretest and the posttest. This should reveal 
more information about student learning in the SMSC curriculum. 


The committee also recognizes that low pretest and posttest scores could be attributed in part to a lack of student effort on the 
tests because doing well doesn’t affect their respective course grades. Some students might consider these tests to bea 
necessary chore to finish quickly rather than an opportunity to demonstrate what they know, 


Two of the senior exit surveys made specific comments about needing more emphasis on diversity and the ethical impact of the 
media, Another student mentioned that this objective came through discussion at the beginning of class, but did not emerge as 
part of assigned or scheduled coursework. This demonstrates that changes do need to be made to ensure students have a better 
understanding of the relevance of human diversity in the media and its societal impact. It should not only be discussed, but also 
applied as part of assignments and assessments of student learning. 


Two comments were made about having more emphasis on the ethical impact of media and the role of mass comm on society. 
This also indicates that the curriculum should include more emphasis on the social role of mass com m/media through course 
content readings, class discussions, assignments and in-class speakers. The school and student groups also can emphasize this 
learning outcome through the SMSC-related speakers invited to campus. 


Two students mentioned that they would like to see more emphasis placed on the theories of mass communications. However, 
one student expressed disappointment that the classes were so heavily based on theory. Many students expressed wanting to 
gain more experience with application and hands-on learning of social media, digital media, SEO, analytics, and design. Based on 
these contradictory comments, | would say that the faculty can do a better job explaining how the relevant theories are applied 
to strategic communications planning and execution and greater emphasis on the application/knowledge of digital media. 


In the senior comments, one student mentioned that he/she felt the SC program did an outstanding job preparing students for 
the real world, Another student expressed that he/she felt confident in his/her expertise going into a full-time career, while 
another said there was no need for improvement in the curriculum. 


Overall, strategic communication students demonstrate a good to outstanding understanding of the Learning objectives, critical 
and creative thinking and writing and editing techniques. 


Dissemination of Findings 

Describe the individual(s) or committee responsible for reviewing and interpreting assessment data: Dr. John McGuire - 
sequence head for Sports Media 

Dr. Joey Senat - sequence head for Multimedia Journalism 

Dr. BobbiKay Lewis - associate dean - College of Arts & Sciences & acting strategic communication sequence head 
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Describe the process for sharing and discussing assessment findings with program faculty: sequence heads, program director 
and associate director send results to all faculty members and discuss results with faculty during faculty meeting 

Program Improvements Based on Assessment 

Based on data collected this year, what changes are being considered or planned for the program?: We plan to revise pre-post 
questions to better reflect the core curriculum; revising one question asked of internship supervisors regarding theories; 
separating students’ results by sequences by adding "your major’ to each pre and post test. 

Based on this year's findings, what (if any) changes are planned for the assessment process?: No changes but may have to ask 
fewer external reviewers to assess each sequence because funding was cut by half this year. Our external reviewers are the 
strongest 

Describe the process for implementing these changes/planned program improvements: Proposal by associate director to 
director; director adds information on faculty agenda; information explained to faculty; faculty vote 

Program Improvements Made in the Last Year: Assessment Measure Improvements, Revised Assessment Plan, Improved 
Faculty Understanding or Buy-In 

Goals for the Coming Year: Sequence heads must replace pre-post test questions; internship supervisor revised questions - 
learning outcome #5 eliminated or replaced 

Is this Summary Report Complete?: Yes 

List all individuals associated with this report preparation: Gina Noble 
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Assessment Impact Report: 
Plans and Findings 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 








Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. 
Oklahoma State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 





Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Graduating seniors agreed strongly to understanding constitutional freedoms & legal and ethical principles 

Number of Students Assessed: 34 

Number of Successful Students: 34 

How were students selected to participate in the assessment of this outcome?: every graduating senior was invited to 
participate in an online survey 

What do the findings suggest about student achievement of this learning outcome?: Students are learning and retaining 
constitutional freedoms & legal and ethical principles information 
































kina Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
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taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning information required in the core classes. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required testing for students in Media Style & 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning as they progress 
through the program 








Outcome: #2 - Relevance of human diversity in mass communications 


Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
given a few weeks before graduation. (Active) 
* Learning Outcome Goal/Benchmark: 4.3 / 5 
Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, 
which would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for 
diversity in mass media and communications. 
Timeline for Assessment: annually 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are confident in their learning of human diversity in mass communication 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 


online survey 
What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 


through the program 











Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 
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Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social 
role, (Active) 

* Learning Outcome Goal/Benchmark: 4/5 

Goal achieved. 

Timeline for Assessment: annually. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students understand the history and role of mass communication, but this is one area where measurement could be expanded. 
Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 
in an online exit survey 

What do the findings suggest about student achievement of this learning outcome?: students are learning as they progress 
through the program. 














Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. (Active) 

* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 


Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better 
reflect assessing student learning in key areas under the history of mass communications and the importance of a free 





press. 
Timeline for Assessment: annually 
Findings 
Reporting Period: 2018 - 2019 09/15/2019 


Conclusion: 1 - Does Not Meet Program Expectations (Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on the pre-post test must be revised. Many questions were deemed as 
too "trivial" in nature by the committee. Questions must be replaced before the next testing session. 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: Required for all students in Media Style and 
Structure and strategic communication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Faculty need to work together to replace 
questions pertaining to history and social role, and faculty need to make sure the information is included in all or most sequence 
classes 





Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 








Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and 
independent thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Findings 
Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers agree students are demonstrating critical, creative and independent thinking in mass communication. 
However, this is hard to access in some digital artifacts. What else can be done to measure creative and independent thinking? 
Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: randomly selected via randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students proficiently demonstrate critical, 
creative and independent thinking in mass communication 


























Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were 
asked to assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors agreed strongly that students’ perform well in critical, creative and independent thinking in mass 
communication 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: students enrolled in internship credit are 
required to have a supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: students are meeting and exceeding 
professionals expectations regarding critical, creative and independent thinking in mass communication 











Outcome: #5 - Relevant theories and concepts of mass 
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communication 
Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Senior Exit Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning 
Outcomes. The survey was given a few weeks before graduation. Question #4 measured relevant theories. (Active) 


* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 /5. 





The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Seniors agree they understand the relevant theories and concepts of mass communication 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to participate 


in an online exit survey 
What do the findings suggest about student achievement of this learning outcome?: students are exposed to and learning 
relevant communication theories, but more could be done by faculty to focus on which theories are presented in which classes to 


expose the students to same theories across the program 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Exam (Active) 
* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication 
theory. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

One question in the pre-post exam deals with theory - more questions should be added - faculty should focus on classes covering 
the theories 

Number of Students Assessed: 140 


Number of Successful Students: 140 
How were students selected to participate in the assessment of this outcome?: required for all graduating seniors enrolled in 


capstone class and all students enrolled in Media Style & Structure 
What do the findings suggest about student achievement of this learning outcome?: faculty should pinpoint theories to be used 


in subsequent classes / more questions written for theory on pre-post exam 






















Supervisor Evaluation - Internship Supervisors were asked to evaluate the student’s understanding of relevant theories 
and concepts in mass communication and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 
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* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - 
meaning theories were not a part of the learning achieved through internship. 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 2 - Meets Minimum Program Expectations (Developing) 

While the internship supervisor's rated students as achieving the goal, the measurement could be stronger. Most supervisors say 
"theories" are not applicable to the internship job - they are just checking a box to help the students. Where else can this 
outcome be measured? 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: All students earning internship credit are 
required to receive an internship supervisor evaluation 

What do the findings suggest about student achievement of this learning outcome?: supervisors are giving a rating to something 
they usually don't measure...many mark it as NA instead of giving a rating 











Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work 
showed evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column !) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 





External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
survey. Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

External reviewers believe students have skills pertaining to information gathering 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: From a graduating senior student list, five 
seniors were selected randomly via randomizer.com 
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What do the findings suggest about student achievement of this learning outcome?: External reviewers believe students are 
proficient in information gathering. Note... measuring informational gathering skills is difficult. 








Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work ona 7-point- 
scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 


Findings 

Reporting Period: 2018 - 2019 09/20/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Reviewers agreed students understood and demonstrated the methods and techniques of research and information gathering. 
Number of Students Assessed: 41 


Number of Successful Students: 41 
How were students selected to participate in the assessment of this outcome?: all students who earn internship credit are 


required to have a supervisor evaluation 
What do the findings suggest about student achievement of this learning outcome?: students are well prepared in the areas of 


research and information gathering 








Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Internship supervisors agree students are well equipped with research and information gathering skills 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the assessment of this outcome?: Required for all credit internships 

What do the findings suggest about student achievement of this learning outcome?: Students are adequately skilled in 
information gathering and other research skills 








Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 
1) evidence of the ability to write clearly and without errors (Excel Column L) 
2) craft language for interesting and effective communication (Excel Column M) 
3) write across platforms effectively (Excel Column N) 
4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online 
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survey. Each reviewer was asked to review the student's work and rate the work on a 5-point-scale. 
1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: Yearly 


Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are proficient in writing but can do more to showcase their skills - students need to include many types of work in their 
digital portfolios. 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the assessment of this outcome?: sample selected from randomizer.com 

What do the findings suggest about student achievement of this learning outcome?: Students have proficient writing skills but 
need to showcase them across more platforms and in different ways. Students should have a lot of samples in their portfolios. 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students 
taking the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone 
courses are post-tested during the last two weeks of class. The exam is the same for both groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 


* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 3 - Meets Program Expectations (Proficient) 

Students are learning the "core curriculum" material because the pre-test scores are lower than the post-test scores 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the assessment of this outcome?: required for all students in Media Style & 
Structure and all students in strategic commu nication capstone classes 

What do the findings suggest about student achievement of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore and senior year. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 

Students will demonstrate an understanding of relevant planning and management methods in mass communication. 

Outcome Status: Active 


Planned Assessment Year: 2018 - 2019 


Assessment Methods 


[ Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was 
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given a few weeks before graduation. Question #5 measured relevant planning responses. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would 
indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: Yearly 











Findings 

Reporting Period: 2018 - 2019 09/15/2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 

Students strongly agree they understand the relevant planning and management methods in mass communication. 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the assessment of this outcome?: all graduating seniors were asked to take an 
online "exit" survey 

What do the findings suggest about student achievement of this learning outcome?: students are comfortable in their skills and 
knowledge of planning and management 
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Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring stat 
effective communicators who facilitate and promote participation i 
change through lifelong learning. Oklahoma State University Schoo 
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Global awareness 
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Outcomes 


Assessment Methods 


Findings 


Use of Findings (Actions) 





#1 - Understanding constitutional 
freedoms & legal and ethical 


principles - Students will demonstrate 


an appreciation of the constitutional 
freedoms, legal issues and ethical 
principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.6 
/5 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Graduating seniors agreed strongly to understanding 
constitutional freedoms & legal and ethical principles 
(09/20/2019) 

Number of Students Assessed: 34 

Number of Successful Students: 34 

How were students selected to participate in the 
assessment of this outcome?: every graduating senior was 
invited to participate in an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning and 
retaining constitutional freedoms & legal and ethical 
principles information 
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#2- Relevance of human diversity in 
mass communications - Students will 
demonstrate an understanding of the 
relevance of human diversity in mass 
communications. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


#3 - History and social role of mass 
communications. - Students will 
demonstrate respect for the history 
and social role of mass 


09/26/2019 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas, 
* Learning Outcome 
Goal/Benchmark: Pretest - Average 
score - 38% 

Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 


Survey - Graduating seniors were 
asked to complete an online "exit" 
survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 

* Learning Outcome 
Goal/Benchmark: 4.3/5 

Goal achieved. The goal was to 
receive a mean score of at least 4 
(out of 5) on each question in the 
senior exit survey, which would 
indicate graduating seniors “agree” 
they understand and have learned a 
lot about the relevance and need for 
diversity in mass media and 
communications. 

Timeline for Assessment: annually 


Survey - Graduating seniors "exit" 
survey - given a few weeks before 
graduation. Question #3 measured 
history and social role. 
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Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning information required in the core 
classes. (09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required testing for students 
in Media Style & Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are confident in their learning of human diversity 
in mass communication (09/15/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?; all graduating seniors were 
asked to take an online survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program 


Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students understand the history and role of mass 
communication, but this is one area where measurement 
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Use of Findings (Actions)| 

















communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 


2019 


#4 - Critical, creative and 


independent thinki 


ng in mass 


communication - Students will 


demonstrate critica 


09/26/2019 


|, creative and 


could be expanded. (09/15/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to participate in an online exit survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are learning as they 
progress through the program. 

Reporting Period: 2018 - 2019 

Conclusion: 1- Does Not Meet Program Expectations 
(Unacceptable) 

Unable to accurately measure results. Questions # 42-50 on 
the pre-post test must be revised. Many questions were 
deemed as too “trivial” in nature by the committee. 


* Learning Outcome 
Goal/Benchmark: 4/5 

Goal achieved. 

Timeline for Assessment: annually. 


Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times, The test is given via Canvas. 
* Learning Outcome 
Goal/Benchmark: Goal not 
achieved. Students performed 
unsatisfactorily on the questions 
asked (questions 42-50) with an 
average of 62%. 


(09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: Required for all students in 
Media Style and Structure and strategic communication 
capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Faculty need to work together 
to replace questions pertaining to history and social role, 
and faculty need to make sure the information is included 
in all or most sequence classes 

Many questions were deemed trivia 

by the committee, and questions 

need to be replaced. Questions need 

to better reflect assessing student 

learning in key areas under the 

history of mass communications and 

the importance of a free press. 

Timeline for Assessment: annually 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
External reviewers agree students are demonstrating 
critical, creative and independent thinking in mass 


Portfolio Review -!n the portfolio 
assessment survey (see Appendix), 
Learning Outcome #4 (critical, 
creative and independent thinking) 
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Assessment Methods Findings i Use of Findings (Actions)| 





independent thinking as they relate 
to individual disciplines in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


is assessed in four categories: communication. However, this is hard to access in some 
1) if the student’s work reflected the digital artifacts. What else can be done to measure creative 
ability to analyze complex situations and independent thinking? (09/15/2019) 


accurately (Excel Column D) Number of Students Assessed: 5 

2) if the student was able to craft Number of Successful Students: 5 

innovative solutions to difficult How were students selected to participate in the 
problems (Excel Column E) assessment of this outcome?: randomly selected via 

3) if the student's work reflected randomizer.com 

looking beyond the obvious (Excel What do the findings suggest about student achievement 
Column F) of this learning outcome?: Students proficiently 

4) if the student had the ability to demonstrate critical, creative and independent thinking in 
effectively communicate complex mass communication 


ideas (Excel Column G) 


External reviewers reviewed 5 
portfolios and received two links; 1) 
a link to a student portfolio, and 2) a 
link to an online survey, Each 
reviewer was asked to review the 
student’s work and rate the work on 
a five-point-scale. 

1= Poor or no representation of 
Learning Outcome 

2= Somewhat poor representation of 
Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved - 
4,2 out of five, which exceeds the 
goal of 4.1 out of five. 


Timeline for Assessment: Yearly 


Supervisor Evaluation - Internship Reporting Period: 2018 - 2019 
Supervisor Evaluation assessment Conclusion: 4 - Exceeds Program Expectations (Advanced) 
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survey (see Appendix) - Internship Internship supervisors agreed strongly that students’ 
Supervisors were asked to assess the perform well in critical, creative and independent thinking 
student's critical, creative and in mass communication (09/15/2019) 

independent thinking / work and Number of Students Assessed: 41 

rate the work on a 7-point-scale. Number of Successful Students: 41 

1 = Not Applicable How were students selected to participate in the 

2 = Understanding Not assessment of this outcome?: students enrolled in 
Demonstrated internship credit are required to have a supervisor 

3 = Demonstrated Only Slightly evaluation 

4 = Demonstrated Occasionally What do the findings suggest about student achievement 
5 = Demonstrated But Needs Work Of this learning outcome?: students are meeting and 

6 = Demonstrated Well exceeding professionals expectations regarding critical, 

7 = Expertly Demonstrated creative and independent thinking in mass communication 


* Learning Outcome 
Goal/Benchmark: The average 
ranking was 6.3 / 7, which exceeds 


the goal of 6. 

#5 - Relevant theories and concepts Survey - Senior Exit Survey - Reporting Period: 2018 - 2019 

of mass communication - Students Graduating seniors were asked to Conclusion: 3 - Meets Program Expectations (Proficient) 

will demonstrate an understanding of complete an online "exit" survey Seniors agree they understand the relevant theories and 

the relevant theories and concepts of regarding Learning Outcomes. The concepts of mass communication (09/15/2019) 

mass communication. survey was given a few weeks before Number of Students Assessed: 33 

Outcome Status: Active graduation. Question #4 measured Number of Successful Students: 33 

Planned Assessment Year: 2018 - relevant theories. How were students selected to participate in the 

2019 * Learning Outcome assessment of this outcome?: all graduating seniors were 
Goal/Benchmark: Goal achieved - asked to participate in an online exit survey 
4.2/5. What do the findings suggest about student achievement 

of this learning outcome?: students are exposed to and 

The goal was to receive a mean learning relevant communication theories, but more could 
score of at least 4 (out of 5) on each be done by faculty to focus on which theories are presented 
question in the senior exit survey, in which classes to expose the students to same theories 
which would indicate graduating across the program 


seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 





Comprehensive, Certification, or Reporting Period: 2018 - 2019 
Professional Exam(s) - Pre-Post Conclusion: 3 - Meets Program Expectations (Proficient) 
Exam One question in the pre-post exam deals with theory - more 
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Findings 


Use of Findings (Actions) 





#6 - Methods and techniques of 
research and information gathering - 
Students will demonstrate an 
understanding of the methods and 
techniques of research and 
information gathering. 

Outcome Status: Active 


09/26/2019 


* Learning Outcome 
Goal/Benchmark: Posttest scores 
demonstrated an understanding of 
the mass communication theory. 


Supervisor Evaluation - Internship 
Supervisors were asked to evaluate 
the student’s understanding of 
relevant theories and concepts in 
mass communication and rate the 
work ona 7-point-scale, 

1 =Not Applicable 

2 = Understanding Not 
Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: Goal achieved - 6 
out of 7. Many supervisor 
evaluations stated "not applicable" - 
meaning theories were not a part of 
the learning achieved through 
internship. 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #6 assessed if the 
students’ work showed evidence for 
1) the ability to gather information 
effectively and competently (Excel 
Column H) 


questions should be added - faculty should focus on classes 
covering the theories (09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all graduating 
seniors enrolled in capstone class and all students enrolled 
in Media Style & Structure 

What do the findings suggest about student achievement 
of this learning outcome?: faculty should pinpoint theories 
to be used in subsequent classes / more questions written 
for theory on pre-post exam 

Reporting Period: 2018 - 2019 

Conclusion: 2 - Meets Minimum Program Expectations 
(Developing) 

While the internship supervisor's rated students as 
achieving the goal, the measurement could be stronger. 
Most supervisors say "theories" are not applicable to the 
internship job - they are just checking a box to help the 
students. Where else can this outcome be measured? 
(09/15/2019) 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: All students earning 
internship credit are required to receive an internship 
supervisor evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: supervisors are giving a rating to 
something they usually don't measure... many mark it as NA 
instead of giving a rating 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
External reviewers believe students have skills pertaining to 
information gathering (09/15/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
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Planned Assessment Year: 2018 - 
2019 


09/26/2019 


2) initiative and creativity in 
information gathering (Excel Column 
1) 

3) use multiple methods and sources 
for research (Excel Column J) 

4) to effectively communicate how 
the information was gathered (Excel 
Column K) 


External reviewers reviewed five 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey. Each 
reviewer was asked to review the 
student's work and rate the work on 
a 5-point-scale, 

1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 
4.1/5 

Timeline for Assessment: Yearly 
Supervisor Evaluation - Internship 
Supervisors provided an overall 
assessment of Learning Outcome #6 
-a student's understanding of the 
methods and techniques used in 
research and information gathering, 
rating the work on a 7-point-scale. 
1 = Not Applicable 


assessment of this outcome?: From a graduating senior 
student list, five seniors were selected randomly via 
randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: External reviewers believe 
students are proficient in information gathering. Note... 
measuring informational gathering skills is difficult. 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Reviewers agreed students understood and demonstrated 
the methods and techniques of research and information 
gathering. (09/20/2019) 

Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
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Outcomes Assessment Methods Findings Use of Findings (Actions)| 
2 = Understanding Not assessment of this outcome?: all students who earn 
Demonstrated internship credit are required to have a supervisor 


#7 - Writing, editing and production 
techniques of mass communication 
specialties - Students will 
demonstrate an understanding of the 
writing, editing and production 
techniques of mass communication 
specialties 

Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 =Demonstrated But Needs Work 
6 = Demonstrated Well 

7 = Expertly Demonstrated 

* Learning Outcome 
Goal/Benchmark: Goal achieved - 
6.2 out of 7 


Portfolio Review - In the External 
Reviewers Portfolio assessment, 
Learning Outcome #7 is assessed in 
four categories: 

13 

1) evidence of the ability to write 
clearly and without errors (Excel 
Column L) 

2) craft language for interesting and 
effective communication (Excel 
Column M) 

3) write across platforms effectively 
(Excel Column N) 

4) communicate to wide and diverse 
audiences (Excel Column O) 


External reviewers reviewed 8 
portfolios and received two links: 1) 
a link to a student portfolio, and 2) a 
link to an online survey, Each 
reviewer was asked to review the 
student’s work and rate the work on 


evaluation 

What do the findings suggest about student achievement 
of this learning outcome?: students are well prepared in 
the areas of research and information gathering 


Reporting Period: 2018 - 2019 

Conclusion: 4 - Exceeds Program Expectations (Advanced) 
Internship supervisors agree students are well equipped 
with research and information gathering skills (09/15/2019) 
Number of Students Assessed: 41 

Number of Successful Students: 41 

How were students selected to participate in the 
assessment of this outcome?: Required for all credit 
internships 

What do the findings suggest about student achievement 
of this learning outcome?: Students are adequately skilled 
in information gathering and other research skills 





Reporting Period: 2018 - 2019 

Conclusion; 3 - Meets Program Expectations (Proficient) 
Students are proficient in writing but can do more to 
showcase their skills - students need to include many types 
of work in their digital portfolios. (09/15/2019) 

Number of Students Assessed: 5 

Number of Successful Students: 5 

How were students selected to participate in the 
assessment of this outcome?: sample selected from 
randomizer.com 

What do the findings suggest about student achievement 
of this learning outcome?: Students have proficient writing 
skills but need to showcase them across more platforms 
and in different ways. Students should have a lot of samples 
in their portfolios. 
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Findings 


Use of Findings (Actions) 





#8 = Relevant planning and 
management methods in mass 


09/26/2019 


a 5-point-scale, 
1= Poor or no representation of 
Learning Outcome 


2= Somewhat poor representation of 


Learning Outcome 

3= Average representation of 
Learning Outcome 

4= Good representation of Learning 
Outcome 

5= Outstanding representation of 
Learning Outcome 


* Learning Outcome 
Goal/Benchmark: Goal achieved: 4 / 
5 

Timeline for Assessment; Yearly 
Comprehensive, Certification, or 
Professional Exam(s) - Pre-Post Core 
Course Curriculum Comprehensive 
Exam. Students taking the first 
writing class (Media Style & 
Structure) are pre-tested during the 
first week of class. Students in 
capstone courses are post-tested 
during the last two weeks of class. 
The exam is the same for both 
groups and is given during class 
times. The test is given via Canvas. 


For LO #7, questions 1-20 were 
counted. 

* Learning Outcome 
Goal/Benchmark: Pre assessment 
score were 76/100. 

Post assessment scores were 83 / 
100. 


Survey - Graduating seniors were 
asked to complete an online "exit" 


Reporting Period: 2018 - 2019 

Conclusion: 3 - Meets Program Expectations (Proficient) 
Students are learning the "core curriculum" material 
because the pre-test scores are lower than the post-test 
scores (09/15/2019) 

Number of Students Assessed: 140 

Number of Successful Students: 140 

How were students selected to participate in the 
assessment of this outcome?: required for all students in 
Media Style & Structure and all students in strategic 
communication capstone classes 

What do the findings suggest about student achievement 
of this learning outcome?: Students are learning, but some 
information seems to be forgotten between sophomore 
and senior year, 


Reporting Period: 2018 - 2019 
Conclusion: 4 - Exceeds Program Expectations (Advanced) 
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Findings Use of Findings (Actions)| 





communication - Students will 
demonstrate an understanding of 
relevant planning and management 
methods in mass communication, 
Outcome Status: Active 

Planned Assessment Year: 2018 - 
2019 


09/26/2019 


survey regarding Learning 
Outcomes. The survey was given a 
few weeks before graduation. 
Question #5 measured relevant 
planning responses. 

* Learning Outcome 
Goal/Benchmark: Goal achieved: 4.6 
/5. 

The goal was to receive a mean 
score of at least 4 (out of 5) on each 
question in the senior exit survey, 
which would indicate graduating 
seniors “agree” they understand and 
have learned a lot about the 
relevance and need for diversity in 
mass media and communications. 
Timeline for Assessment: Yearly 


Students strongly agree they understand the relevant 
planning and management methods in mass 
communication. (09/15/2019) 

Number of Students Assessed: 33 

Number of Successful Students: 33 

How were students selected to participate in the 
assessment of this outcome?: all graduating seniors were 
asked to take an online "exit" survey 

What do the findings suggest about student achievement 
of this learning outcome?: students are comfortable in 
their skills and knowledge of planning and management 
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Program Plans: Outcomes and 
Assessment Methods 


Program (CAS) - SMSC - Strategic Communication (BS) - 475 











Program Mission Statement: To educate the future leaders in mass communication from Oklahoma, its neighboring states, the 
nation and the world to be responsible and effective communicators who facilitate and promote participation in a democratic 
society through excellence in practice, ethical behavior, a critical stance, and embracing change through lifelong learning. Oklahoma 
State University School of Media & Strategic Communications will do this by promoting: 

Critical thinking 

Creativity 

Global awareness 

Appreciation for the liberal arts 

Adaptability 

Problem solving skills 

Diversity 

Leadership 

Community involvement 











Outcome: #1 - Understanding constitutional freedoms & legal and 
ethical principles 


Students will demonstrate an appreciation of the constitutional freedoms, legal issues and ethical principles involved in mass 
communication. 

Outcome Status: Active 

Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 

* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 /5 

The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: annually 
































Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 





* Learning Outcome Goal/Benchmark: Pretest - Average score - 38% 
Posttest - Average score - 71% 

Goal achieved. 

Timeline for Assessment: annually 





Outcome: #2 - Relevance of human diversity in mass communications 
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Students will demonstrate an understanding of the relevance of human diversity in mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. (Active) 








* Learning Outcome Goal/Benchmark: 4.3 /5 

Goal achieved. The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which 
would indicate graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in 
mass media and communications. 

Timeline for Assessment: annually 





Outcome: #3 - History and social role of mass communications. 


Students will demonstrate respect for the history and social role of mass communications. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 
Survey - Graduating seniors "exit" survey - given a few weeks before graduation. Question #3 measured history and social role. 
(Active) 
* Learning Outcome Goal/Benchmark: 4 / 5 


Goal achieved. 
Timeline for Assessment: annually. 






































Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam. Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. (Active) 


* Learning Outcome Goal/Benchmark: Goal not achieved. Students performed unsatisfactorily on the questions asked 
(questions 42-50) with an average of 62%. 








Many questions were deemed trivia by the committee, and questions need to be replaced. Questions need to better reflect 
assessing student learning in key areas under the history of mass communications and the importance of a free press. 
Timeline for Assessment: annually 








Outcome: #4 - Critical, creative and independent thinking in mass 
communication 


Students will demonstrate critical, creative and independent thinking as they relate to individual disciplines in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the portfolio assessment survey (see Appendix), Learning Outcome #4 (critical, creative and independent 
thinking) is assessed in four categories: 
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1) if the student’s work reflected the ability to analyze complex situations accurately (Excel Column D) 
2) if the student was able to craft innovative solutions to difficult problems (Excel Column E) 

3) if the student’s work reflected looking beyond the obvious (Excel Column F) 

4) if the student had the ability to effectively communicate complex ideas (Excel Column G) 


External reviewers reviewed 5 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a five-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 out of five, which exceeds the goal of 4.1 out of five. 





Timeline for Assessment: Yearly 














Supervisor Evaluation - Internship Supervisor Evaluation assessment survey (see Appendix) - Internship Supervisors were asked to 
assess the student's critical, creative and independent thinking / work and rate the work on a 7-point-scale. 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 


* Learning Outcome Goal/Benchmark: The average ranking was 6.3 / 7, which exceeds the goal of 6. 








Outcome: #5 - Relevant theories and concepts of mass 
communication 


Students will demonstrate an understanding of the relevant theories and concepts of mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Senior Exit Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The 
survey was given a few weeks before graduation. Question #4 measured relevant theories. (Active) 














* Learning Outcome Goal/Benchmark: Goal achieved - 4.2 / 5. 


The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 
communications. 

Timeline for Assessment: Yearly 











Comprehensive, Certification, or Professional Exam(s) - Pre-Post Exam (Active) 








* Learning Outcome Goal/Benchmark: Posttest scores demonstrated an understanding of the mass communication theory. 
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Supervisor Evaluation - Internship Supervisors were asked to evaluate the student’s understanding of relevant theories and 
concepts in mass communication and rate the work ona 7-point-scale, 

1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 





* Learning Outcome Goal/Benchmark: Goal achieved - 6 out of 7. Many supervisor evaluations stated "not applicable" - meaning 
theories were not a part of the learning achieved through internship. 











Outcome: #6 - Methods and techniques of research and information 
gathering 


Students will demonstrate an understanding of the methods and techniques of research and information gathering. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #6 assessed if the students’ work showed 
evidence for 

1) the ability to gather information effectively and competently (Excel Column H) 

2) initiative and creativity in information gathering (Excel Column |) 

3) use multiple methods and sources for research (Excel Column J) 

4) to effectively communicate how the information was gathered (Excel Column K) 








External reviewers reviewed five portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 


* Learning Outcome Goal/Benchmark: Goal achieved: 4.1/5 
Timeline for Assessment: Yearly 

















Supervisor Evaluation - Internship Supervisors provided an overall assessment of Learning Outcome #6 - a student's 
understanding of the methods and techniques used in research and information gathering, rating the work on a 7-point-scale. 
1 = Not Applicable 

2 = Understanding Not Demonstrated 

3 = Demonstrated Only Slightly 

4 = Demonstrated Occasionally 

5 = Demonstrated But Needs Work 

6 = Demonstrated Well 

7 = Expertly Demonstrated (Active) 














* Learning Outcome Goal/Benchmark: Goal achieved - 6.2 out of 7 
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Outcome: #7 - Writing, editing and production techniques of mass 
communication specialties 


Students will demonstrate an understanding of the writing, editing and production techniques of mass communication specialties 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Portfolio Review - In the External Reviewers Portfolio assessment, Learning Outcome #7 is assessed in four categories: 
13 

1) evidence of the ability to write clearly and without errors (Excel Column L) 

2) craft language for interesting and effective communication (Excel Column M) 

3) write across platforms effectively (Excel Column N) 

4) communicate to wide and diverse audiences (Excel Column O) 





External reviewers reviewed 8 portfolios and received two links: 1) a link to a student portfolio, and 2) a link to an online survey. 
Each reviewer was asked to review the student’s work and rate the work on a 5-point-scale. 

1= Poor or no representation of Learning Outcome 

2= Somewhat poor representation of Learning Outcome 

3= Average representation of Learning Outcome 

4= Good representation of Learning Outcome 

5= Outstanding representation of Learning Outcome 


(Active) 
* Learning Outcome Goal/Benchmark: Goal achieved: 4/5 
Timeline for Assessment: Yearly 























Comprehensive, Certification, or Professional Exam(s) - Pre-Post Core Course Curriculum Comprehensive Exam, Students taking 
the first writing class (Media Style & Structure) are pre-tested during the first week of class. Students in capstone courses are post- 
tested during the last two weeks of class. The exam is the same for both groups and is given during class times. The test is given 
via Canvas. 


For LO #7, questions 1-20 were counted. (Active) 











* Learning Outcome Goal/Benchmark: Pre assessment score were 76/100. 
Post assessment scores were 83 / 100. 





Outcome: #8 = Relevant planning and management methods in mass 
communication 


Students will demonstrate an understanding of relevant planning and management methods in mass communication. 


Outcome Status: Active 
Planned Assessment Year: 2018 - 2019 


Assessment Methods 


Survey - Graduating seniors were asked to complete an online "exit" survey regarding Learning Outcomes. The survey was given a 
few weeks before graduation. Question #5 measured relevant planning responses. (Active) 
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* Learning Outcome Goal/Benchmark: Goal achieved: 4.6 / 5. 
The goal was to receive a mean score of at least 4 (out of 5) on each question in the senior exit survey, which would indicate 
graduating seniors “agree” they understand and have learned a lot about the relevance and need for diversity in mass media and 


communications. 
Timeline for Assessment: Yearly 
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Appendix 9-3 - Senior Exit Survey Results 
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Appendix 9-4 - Internship Evaluations 


COLLEGE OF ARTS & SCIENCES 


School of Media & Strategic Communications 


id 
OKLAHOMA 


UNIVERSITY 
=== 





206 Paul Miller Building 
Stillwater, OK 74078-4053 


P: 405-744-6354 
F: 405-744-7104 


Internship Supervisor Evaluation Form 
Spring 2019 





Internship Supervisors... 
please email completed form no later than May 3, 2019, to: 
gina.noble@okstate.edu 











Intern’s Name: 





Place of Internship: 





Dates of Internship: 





Date of Evaluation: 





Name and Title of Supervisor completing evaluation: 


Supervisor's phone number: 





Supervisor’s email: 





NOTE: It is important that the “Internship Supervisor” review this 
evaluation with the student. 


Date evaluation reviewed with student-intern: 





Student signature: 





Supervisor signature: 





Overall Evaluation of Intern 


1. Please describe the student’s internship duties with your organization. 


2. Please evaluate the student’s performance in terms of her/his interpersonalrelations 
with supervisors, colleagues and public contacts. 


3. Please provide comments regarding the intern’s overall performance during the 
internship. This includes any advice, praise and/or constructive criticism. The goal of 
constructive criticism is to help the student improve his/her skills before graduation. 


4. If applicable, please provide comments regarding the student’s writing ability. 


5. If applicable, please provide comments regarding the student’s critical thinking skills? 


6. If applicable, please provide comments regarding the student’s ability to follow 
directions and work with minimal supervision. 


7. If applicable, please provide comments regarding the student’s time management 
skills. 


8, Please provide any other comments you feel are necessary to help Oklahoma State 
University’s School of Media & Strategic Communication prepare its students for 
internships and the workforce. 


9. What software was the student expected to know prior to beginning the internship? 


10. Was the intern paid for this internship? If so, what was the hourly wage? 


Skill and Knowledge Evaluation 


The student intern has not yet completed degree requirements for graduation. Bearing this in 
mind, please rate her/him on the list of skills below. Use the ranking scale that follows and place 
the appropriate mark by each item: “NA” = not applicable, “F” = unsatisfactory, 

“D” = Fair, “C” = Good, “B” = Very Good, “A” = excellent. 


(NOTE: It is important that the “Evaluator” review this evaluation with the student before 


submitting it to the supervising instructor. 





(F) 


Not Applicable 





T| Unsatisfactory 
O| Fair (D) 

O| Good (C) 

W| Very good (B) 


D| Excellent (A) 





1. Understands the fundamental communications challenges in 
specific assignments. 





2. Recognizes target audiences and can direct communication to 
them effectively. 





3. Thinks creatively with assignments. 





4. Writes with appropriate style. 





(Sz) 


. Writing skills. 





6. Attention to details. 





7. Ability to deal with ideas. 





8. Overall ability to visualize situations. 





9. Computer skills. 





10. Photography skills. 





11. Design and layout skills. 





12. Interpersonal skills. 





13. Other 





























Recommended Internship Grade (please circle one grade): A B C D F 





The following are the overall learning outcomes expected of all graduates from the 
School of Media & Strategic Communications. These reflect the core values and 
competencies specified by The Accrediting Council for Journalism and Mass 
Communication as expected of all graduates of an accredited program. This part of the 
evaluation is intended to assist us in improving our program to better facilitate these 
outcomes. 


On a scale from one to seven, please indicate to what extent you believe the student 
demonstrates the following characteristics. Some of these may not be applicable, but 
we are interested in the skills and abilities you have observed while the student worked 
under your supervision. 








3 5 
; 2 
To what extent does the intern demonstrate the o| Elz o 5 5 > 
. . . ~ + oO 
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2 O C E 20 50 i © 
a) E| BD) 25| 23| B | >% 
e| S| S| s| 98/5 | 55 
3/3| 57| 8) 53 59 85 
z| z| â| ás | ae| ål as 
11213 4 5 6 |7 





1. An understanding of the relevant constitutional 
freedoms, legal issues and ethical principles in mass 
communications. 





2. An understanding of the relevance of human 
diversity in mass communications. 





3. An understanding of the history and social role of 
mass communications. 





4. Critical, creative and individual thinking. 





5. An understanding of the relevant theories and 
concepts of mass communications. 





6. An understanding of the methods and techniques of 
research and information gathering. 





7. Appropriate writing, editing and production techniques 
in mass communications. 








8. An understanding of relevant planning and 
management methods in mass communications. 


























Thank you for giving an OSU student the opportunity to 
work with you and your organization. If you would like to 
post an open job or internship opportunity on our student 
page, please send a description to 


gina.noble@okstate.edu 





Appendix 9-5 - Student Awards 


Student National and Regional Awards 2014-2019 


2019 
National Awards 

ə Thomas Fleming, Second Place, Television Sports Talent, Broadcast 
Education Association Festival of Media Arts. 

e Kassie Gann, Third Place, Television News Magazine, Broadcast Education 
Association Festival of Media Arts. 

e Thomas Fleming, Award of Excellence, Radio Sports Play-by-Play, Broadcast 
Education Association Festival of Media Arts 

e Hallie Hart, Finalist, Sports Writing, SPJ Mark of Excellence Awards. 

Regional Awards 

© Hallie Hart, First Place, Sports Writing, SPJ Region 8 Mark of Excellence 

Awards. 
2018 
National Awards 

e Matt McGann, Max Gross, Lucas Messina, & Tyler Seggerman, First Place, 
Student Television Sports News Program, Broadcast Education Association 
Festival of Media Arts. 

e Addison Skaggs, Second Place, Student Television Sports Story, Broadcast 
Education Association Festival of Media Arts. 

e Josh Wagner, James Leblanc, Jacobi Campbell & Jacob Hudson, Award of 
Excellence, Student Documentary, Broadcast Education Association Festival 
of Media Arts. 

State Awards 


e Dekota Gregory, First Place, General News Writing & Reporting, Oklahoma 
Collegiate Media Association. 


e Nuria Martinez-Keel, First Place, Feature Writing, Oklahoma Collegiate Media 
Association. 


2017 
National Awards 
e Ali Brooks, First Place, Student Television News Anchor, Broadcast 


Education Association Festival of Media Arts. 


e Brian Shrull, First Place, Student Television Sports Story, Broadcast 
Education Association Festival of Media Arts. 

ə OSU Student Advertising Team, Second Place, American Advertising 
Federation's National Student Advertising Competition. 


Student National and Regional Awards 2014-2019 


ə Nathan Ruiz, Finalist, National Writing Championship, Hearst Journalism 
Awards Program. 


ə Stetson Payne, Third Place, Personality/Profile, Hearst Journalism Awards 
Program. 


016 


—— 


National Awards 
e Cody Stavenhagen, Second Place, National Writing Championship, Hearst 


National Awards Program. 


e Kaelynn Knoerschild, Finalist, National Writing Championship, Hearst 
National Awards Program. 


e Cody Stavenhagen, First Place, Sports, Hearst National Awards Program. 


ə Dan Linblad, First Place, Radio Sports Story, Broadcast Education 
Association Festival of Media Arts. 


e Kurtis Quillin, First Place, Television Sports Story and Television Talent Reel, 
Broadcast Education Association Festival of Media Arts. 


201 
National Awards 
e Cody Stavenhagen, Second Place, National Writing Championship, Hearst 


National Awards Program. 
e Cody Stavenhagen, Third Place, Sports, Hearst National Awards Program. 


e Cody Stavenhagen, Fifth Place, Personality/Profile, Hearst National Awards 
Program. 


State Awards 
e The O'Colly, First Place, In-Depth Enterprise Reporting & Photography, 
Oklahoma Press Association Better Newspaper Contest. 


e Caleb Surly, First Place, Television Feature News Story, Oklahoma 
Broadcast Education Association. 


014 
National Awards 
e Chris Brintle & Jase Chilcoat, Third Place, Sports (Radio) Play-by-Play, 


Broadcast Education Association Festival of Media Arts. 


Student National and Regional Awards 2014-2019 


e Seth Becker, Second Place, Sports (Television) Event Production, Broadcast 
Education Association Festival of Media Arts. 


State Awards 
e The O'Colly, First Place, News Writing, Editorial Comment, & Sports 
Coverage, Oklahoma Press Association Better Newspaper Contest. 


e Jose Polanco, First Place, Radio Sports Magazine/Talk, Oklahoma Broadcast 
Education Association. 


ə Caleb Potts & Sarah McCall, Television News Feature Story, Oklahoma 
Broadcast Education Association. 


Appendix 9-6 - Alumni Information 


First Name LastName Grad Year 


Alex 
Chad 
Abreeyia 
Meagan 
Caroline 
Murphy 
Ashley 
Raychel 
Lance 
Jordan 
Timothy 
Sarah 
Jarrett 
Nicole 
James 
Jordan 
Colby 
Michael 
Robert 
Kieran 
Dylan 
Brian 
Kelly 
Paige 
William 
Catherine 
Michele 
Patrick 
Daniel 
Dena 
Seth 
Timothy 
Kaitlin 
Alyssa 
Rachael 
Diana 
Macy 
Chandler 
Hannah 
Morgan 
Ariel 


Batchelor-Sti 
Crockett 
Hilliard 
Kascsak 
Lee 
Mitchell 
Ray 

Rich 
Spence 
Tidwell 
Ahrens 
Bildstein 
Hardwick 
Hart 
Lomenick 
Neal 
Powell 
Ray 
Sanders 
Steckley 
Tucker 
Van Haaften 
Ball 
Bittle 
Carr 
Corley 
Crater 
Elliott 
Hernandez 
Jackson 
Jacobs 
Krenz 
Loyd 
Loza 
Maltby 
Martinez 
Myrick 
Robertson 
Slater 
Wells 
West 


2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 
2015 


Degree 1 

BS - BACH-SCIENCE 
BA - BACH-ARTS 
BA - BACH-ARTS 
BA - BACH-ARTS 
BA - BACH-ARTS 
BA - BACH-ARTS 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BS - BACH-SCIENCE 
BA - BACH-ARTS 
BA - BACH-ARTS 


Major 1 

MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
MULTIMEDIA JOURNALISM 
SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

SPORTS MEDIA 

STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 
STRATEGIC COMMUNICATION 


Company Name 
RUN Studios 
OSU/CEAT 
Employer Unknown 
City of Stillwater 
KJRH 


Job Title 

Associate Producer 
Computer Specialist 
Associate Producer 


Content Coordinator 


New York County Defender Servi Attorney 


Simplicity & Co 

AT&T 

US Senator James Lankford 
Channel 5 News 

Stillwater NewsPress 
Oklahoma State University 
Oral Roberts University 
Texas Rangers Baseball Club 
OSU/CEAT 

Bowie News 

KOKC 

Keller Williams Realty 
United Parcel Service 
Stillwater NewsPress 
Cherokee Nation 

KSFY-TV 


Owner/Tea Tender 
Digital Media Assistant 
Reporter 


Communications Specialist 
Media Relations Assistant 


Premium Services Coordinator 


Multimedia Producer 
Sports Editor 
Producer 

Realtor 


Local Government Reporter 
Outreach/Admissions 
Sports Reporter 


Red Classic Transportation Servic Marketing Services 


Cain Watters & Associates 
OSU Alumni Association 
Baker Ihrig & Corley 


Brentwood United Methodist Chi Content and Social Media Coordinator 


Cerner Corp 

TBS 

National Life Group 

Pepsi 

National Instruments 

VI Marketing & Branding 
Folds of Honor 

Oklahoma City Indian Clinic 
Tyler Media 

Camp War Eagle 

Cowan Group Engineering 
VI Marketing and Branding 
Fidelity Bank 

University of Central Oklahoma 


Digital Communications Specialist 


Coordinator/Communications 
Legal Assistant 


IT Consultant 

Accounting 

Coordinator 

Food Service Representative 


University Recruiting Program Manager 


Digital Media Coordinator 
Social Media Coordinator 
Graphic Designer 
Account Executive 

Youth Director 

Marketing Coordinator 
Traffic Coordinator 

Teller Il 

Digital Media Coordinator 


Appendix 9-7 - Alumni Surveys 


OKLAHOMA 


America’s Brightest ORANGE 


UNIVERSITY. 





Oklahoma State University 


University Assessment and Testing 


2019 OSU Alumni Survey 


Survey Report — Multimedia Journalism 


The OSU Alumni Survey is a survey designed to collect information about OSU graduated students. More 
specifically, it is designed to collect information on their career, educational achievements, and their experience 
with OSU. This information will be used to improve academic programs and student experiences at OSU for 
generations to come. This survey targeted alumni of undergraduate and graduate programs who received their 
degree in 2013 and/or 2017. The survey was administered online by OSU-University Assessment and Testing 
(UAT) in April 2019 through June 2019. Departments may request additional information by contacting UAT 


(assessment@okstate.edu). 


Survey Questions 


Respondents were asked 37 institutional level items. Institutional level items were given to all OSU alumni and 
the items consisted of six topics: continuing education, well-being and community, demographic information, 
academic satisfaction, career reflection, and current job or career information. 


Target Population / Response Rate — Multimedia Journalism 


Number of graduates (n) 12 22 34 
Number of survey respondents (n) 4 7 11 
Response rate 33.3% 31.8% 32.4% 


2019 OSU Alumni Survey 
Multimedia Journalism Respondents 





Not engaged in paid employment, nor enrolled in 
graduate or professional school 


Enrolled in graduate or professional school 
Employed full-time or part-time 


Both employed (other than graduate assistant) and 
continuing my education 


Self-employed 








Engineering 

Computer Science, Programming or Technology 
Science, Social Science, or Mathematics 
Health or Mental Health 

Business or Management 

Finance or Accounting 

Education, Training, or Library 

Legal 

Writing, Journalism, or Design 

Public Service, Policy, or Politics 

Public Relations, Marketing, or Sales 
Architecture 

Art, Performing, or Athletics 

Participating in a volunteer or service program 
Serving in the U.S. military 

Other occupational area (INSERT FIELD) 





0 0.0 0 0.0 
_— 0 00 o 00% 
| Oo. o ooo 
a ie 2.0 | ol 0.0 
i ae 2.0 | oO 0.0 
~~ 0 00 o 00% 
— © oe 2.0 | ooo 0.0 





0 0.0 0 0.0 
_ 4 0 00 o 00% 
wl 0 00 0 00% 
a 0 00° 0 0.00 
a . = a 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Continuing Education 


N 
= 
oO 


2017 





Graduate Certificate 
Master's 


Doctoral 


Medical (includes nursing, osteopathy, dental, vet, and 
more) 


Law 
Other (INSERT FIELD) 
Prefer not to answer 


Cooley Law School 
Dominican University 
North Texas 

Oklahoma State University 


Very well 
Adequately 

Not very well 

Not at all 

Prefer not to answer 


0 0.0 0 0.0 
0 oo 2. 667. — 
~~ 1 1000 = o o i ooo 
i oo o oo o ooo 
o rr a 33.3 
2: O00 00 
E 0 oO o ooo 





2013 2017 
1 100.0 2 66.7 
aa C oo * £4933 — 
— oo 00 0 ooo 
l ooo o o0 o ooo 
l 0 00 — 0 00% 


*For items 3 through 5 do not include alumni who responded: ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’, ‘Employed full-time or part-time’, or ‘self-employed’ in item 1. 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Well-being & Community 


Very connected 
Moderately connected 
Somewhat connected 

Not very connected 


0 0.0 2 28.6 
ee 70 | 30 ©6429 
ae 1 20 1. 14.300 — 
i aia 00 1 . 143 





Yes, with my advisor(s) 


Yes, with professors or staff 

Yes, with members of my team, club, or sorority/fraternity 
Yes, with classmates/friends | met at OSU 

No 


0 0.0 0 0.0 
ae 1 50o ’3 
a 0 OO 3 429 — 
4 100.000¢~2@~O~— 6 nnn i 85.7 
a 0 o oon a 43 





Very Much 


Somewhat 
Little 
None 


More than once a week 
About once a week 

About once a month 

Every few months 

Once or twice in the past year 
Not at all 





3 75.0 4 57.1 
—_ 1 20 it 43 
a 0O oon 2 28.6 
l 0 00 o ooo 

2013 2017 


0 0.0 0 0.0 
a 0 OO 4 14.3000 
a. 1 2350o oo o ooo 
m 1o 50o a 
n 2 500 2 286 — 
a 0 00 3 go 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


How would you change the emphasis OSU placed on these aspects of education and 


college life? 


2013 2017 





Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


0 0.0 1 14.3 
a 0 00 0 ooo 
2 500 4 5714 — 
4 0 OO 41 14.3007 
a 1 420 4ed@ 43 
oes 1  - 2500C~é“‘ o COM 





Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 





0 0.0 0 0.0 
| 0 OO 1 14.3°0°~ 
eS 0 OO 2. Beo 
Ea 3 60 14 4143 — 
ae 1 2500t—“‘ ]!”*<“<;*‘C SS 
sl 6 66 6 ooo 

2013 2017 


0 0.0 0 0.0 
l 0 O00 (0 ooo 
a 1 20 4 S71 
a 0 00 3 g 
M 3 70 oO ooo 
—_ 0 00 (0 ooo 
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Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


2019 OSU Alumni Survey 
Multimedia Journalism Respondents 








Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


0 0.0 0 0.0 
| 0 00 0 ooo 
ae 0 OO 4 14.3000 
a 1o 2350o ‘3a ag 
aa 2 500 3 429 — 
T 1o 50o o ooo 

2013 2017 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Demographics 
2013 2017 
Stillwater 4 100.0 7 100.0 
Tulsa | 0 oon o 0.0 
Equally Stillwater or Tulsa 0 > 00 S. 0 o a 0 .0 Pas 
Online 0 0.0 0 0.0 
CO 1 0 Pe eames 
Ue a Sennen nee | rere 
NC a P a 
OK 2. 2 ee 
a, ee Se Sa ne 
TX 0 1 


University Assessment and Testing 
http://uat.okstate.edu 








7 


2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Academic Satisfaction 


Please rate your degree of satisfaction with each of the following items: 





Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 





0 0.0 1 14.3 
“4 1000 °° 4000 57.1 
i 4 00 i 0.0 
ie: anne 00 - = 286 
a ee 00 O00 0.0 
ooo o0 ooo 00 

2013 2017 


1 25.0 1 14.3 
i 3 60 44 5 
m 0 O00 a2 Be 
—_ 0 00 0 ooo 
m 0o o oon 0 0.000 
—_ 0 00 0 ooo 

2013 2017 


0 0.0 0 0.0 
a 1 20 43 429 — 
a 2 500 «@ 143 
a 1 50o ‘3a aa 
—_ 0 00 0 ooo 
l 0 00 (0 ooo 

2013 2017 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 





Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 
Neutral 
Dissatisfied 
Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Definitely yes 
Probably yes 
Uncertain 
Probably no 
Definitely no 

















3 75.0 2 28.6 
Ea e 
i 0 O00 0 ooo 
a 0 O00 0 ooo 
| 0o o oo TaT 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Career Reflection 


2013 2017 
Not related 2 50.0 0 0.0 
Somewhat related — 1 bees 2 5.0 atest 2 Fe 2 8.6 a 
Directly related 1 25.0 5 71.4 





Very well 2 50.0 3 42.9 
Adequately ss 2 500 °°» « 4 | 571 
Not very well 0 00 0 00 
Notatall 0 O00 ; 4 00 
Prefer not to answer sits 0 oo  « a 00 | 

2013 2017 

Very Satisfied 1 25.0 5 71.4 
Satisfied ` 3 750 °° | iis 00 o 
Neutral sis 0 OO © i: 14.3 
Dissatisfied oo o OG Tooo 14.3 
Very Dissatisfied 0 oon oO 00 o 


*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Current Job or Career 





Full-time 
Part-time 





Employed by graduation 

3 months after graduation 

6 months after graduation 

9 months after graduation 

1 year after graduation 

over 1 year after graduation 








Chicago Public Schools 


Teacher 





Dallas Cowboys 


Video Intern 





Love's Travel Stops 


Internal Communications Specialist 





Driver iQ 


Sales Support Assistant 





Oklahoma State University Student Union 


Digital Media Specialist 





Broken Arrow Public Schools 


Mental Health Therapist 





Riggs Abney 


Legal Intern 





Microbac Laboratories 


Creative media specialist 





[Tegna 


Videographer 





WCTI NewsChannel 12 











TV News Reporter/Anchor 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item. 
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2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


A corporation, partnership, or private business 

a Military 
Other governmental entity 
Charity or other nonprofit entity 
Educational institution 

Other 0 0.0 0 0.0 





Prefer not to answer 0 0.0 0 0.0 





Technology skills 4 100.0 3 50.0 
Conducting research sis oo go  “ 3 | 50.0 
Extensive training st 2 500 © i | 16.7 
Math skills Ss 2 500 | - “a 33.3 


Problem solving/analytic reasoning 





Speaking to a group 


Use of specialized machinery 1 25.0 1 16.7 
Use of specialized software sié«: 2 500 o 4. £667. 
Working with a diverse group of people tit 4 1000} | 6. 100.0 
Writing reports, memos, papers, publications, etc. > 3 750 4 6 >? 100.0 





Less than $15,000 
$15,000 but less than $25,000 
$25,000 but less than $35,000 
$35,000 but less than $45,000 
$45,000 but less than $55,000 
$55,000 but less than $65,000 
$65,000 but less than $75,000 

$75,000 but less than $100,000 
$100,000 but less than $125,000 
$125,000 but less than $150,000 
Over $150,000 

Prefer not to answer 0 0.0 1 16.7 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 


University Assessment and Testing 
http://uat.okstate.edu 








12 


2019 OSU Alumni Survey 
Multimedia Journalism Respondents 


Not much. | have a degree in journalism but am not a journalist nor have a high paying job so | wish | could have 
been steered toward a business degree. 

More faculty with internship connections to major organizations would have been nice. | would love for OSU to 
update its journalism building; OSU has a great program, but | felt prospective students were turned off by the 
building itself. As a former journalist turned communications professional, it would be nice to see a more integrated 
curriculum, combining strategic comms and multimedia journalism courses. 

Better facilities and technology in the journalism building 

Hire better advisors in general that actually ADVICE and help/guide young students. In my opinion, that's OSU's 
biggest flaw. 

Put less money into football and Greek life and put more into education 

Eliminate some of the general education requirements. | enjoyed the classes outside of my major, but the extra 
student loans were not worth it. 


Upgrade the journalism building, that thing is so old. 
































| have many memories in Stillwater | will never forget. Go Pokes 
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Survey Report — Sports Media 


The OSU Alumni Survey is a survey designed to collect information about OSU graduated students. More 
specifically, it is designed to collect information on their career, educational achievements, and their experience 
with OSU. This information will be used to improve academic programs and student experiences at OSU for 
generations to come. This survey targeted alumni of undergraduate and graduate programs who received their 
degree in 2013 and/or 2017. The survey was administered online by OSU-University Assessment and Testing 
(UAT) in April 2019 through June 2019. Departments may request additional information by contacting UAT 
(assessment@okstate.edu). 


Survey Questions 

Respondents were asked 37 institutional level items. Institutional level items were given to all OSU alumni and 
the items consisted of six topics: continuing education, well-being and community, demographic information, 
academic satisfaction, career reflection, and current job or career information. 


Target Population / Response Rate — Sports Media 





Number of graduates (n) 17 35 52 


Number of survey respondents (n) 4 10 14 





Response rate 


2019 OSU Alumni Survey 
Sports Media Respondents 





Not engaged in paid employment, nor enrolled in 
graduate or professional school 


Enrolled in graduate or professional school 





















Employed full-time or part-time 


Both employed (other than graduate assistant) and 
continuing my education 


Self-employed 


Engineering 

Computer Science, Programming or Technology 
Science, Social Science, or Mathematics 
Health or Mental Health 

Business or Management 

Finance or Accounting 

Education, Training, or Library 

Legal 

Writing, Journalism, or Design 

Public Service, Policy, or Politics 

Public Relations, Marketing, or Sales 
Architecture 

Art, Performing, or Athletics 

Participating in a volunteer or service program . . 
Serving in the U.S. military 0 0.0 0 0.0 


Other occupational area (INSERT FIELD) 1 25.0 1 10.0 
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2019 OSU Alumni Survey 
Sports Media Respondents 


Continuing Education 


2013 2017 





Graduate Certificate 0 0.0 0 0.0 
Masters sis 0 oo 4a | 50.0 
Doctoral i= 0 oo | oO 00 
Medical (includes nursing, osteopathy, dental, vet, and sé 0 oo | ia 00. 
A ar rc eee edna 
Law 0 0.0 1 50.0 
Other (INSERT FIELD) ` 0-0 0000 es 0.00 
Prefer not to answer sis 0 00 4 00 
Oklahoma State University 0 1 
University of Kansas a 
2013 2017 
Very well 0 0.0 0 0.0 
Adequately | ooo 00 | 2 1000 
Not very well = ooo 00 | oO 0.0 
Notatall Ss 4) 00 | oO | 0.0 
Prefer not to answer sis 0 00 | oO 0.0 


*For items 3 through 5 do not include alumni who responded: ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’, ‘Employed full-time or part-time’, or ‘self-employed’ in item 1. 
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2019 OSU Alumni Survey 
Sports Media Respondents 


Well-being & Community 


Very connected 
Moderately connected 
Somewhat connected 

Not very connected 


1 25.0 2 222 
2 ooo 500 | 5 55.6 
T 1 20 41 a 
i aa? 00 t. W400 





Yes, with my advisor(s) 


Yes, with professors or staff 

Yes, with members of my team, club, or sorority/fraternity 
Yes, with classmates/friends | met at OSU 

No 


0 0.0 0 0.0 
oe 2 500 44 444 — 
— { 20 3 $33 
4 400.00 8 nnn 88.9 
a oo o is Pi aie 





Very Much 


Somewhat 
Little 
None 


More than once a week 
About once a week 

About once a month 

Every few months 

Once or twice in the past year 
Not at all 





2 50.0 6 66.7 
_— 2 500 3 333 
0 00 oO. 00 — 
l 0 00 (0 ooo 

2013 2017 


0 0.0 0 0.0 
a 0o o oon ii (lie 
od i a ai ie 
oe 2 500 2 222 
i 0 O00 a2 22 
4 2 500 2 £222 
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2019 OSU Alumni Survey 
Sports Media Respondents 


How would you change the emphasis OSU placed on these aspects of education and 


college life? 





Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


0 0.0 0 0.0 
—_ 0 O00 0 ooo 
i 0 OO 3 E — 
a 4 10.0 5 556 
D 0 O00 o o0 
l 0 oO 1 a 

2013 2017 








Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 





0 0.0 0 0.0 
aa 0 O00 O00 — 
a 1 50o 5 56 
—_ 00 3 333 
= 3. 70 41 444 
l 0 00 0 ooo 
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2019 OSU Alumni Survey 
Sports Media Respondents 


2013 2017 





Reduce a great deal 0 0.0 0 0.0 
Reduce somewhat 0 OO oO 00 o 
Keep about the same 1 260 « 4 44.40 
Increase somewhat 1 250 °° | 3 333 
Increaseagreatdeal sé 20° 500 i 2 7 22 
Idon'tknow 0 00 GY 00 

2013 2017 

Reduce a great deal 0 0.0 0 0.0 
Reduce somewhat sits 0 oo | i 00 o 
Keep about the same | 0 oO | 3 33 
Increase somewhat tt 3 0 °°} | ae a 
Increase a great deal it 1 20 | —.e 33.3 
Idon'tknow 0 OO © i: 7 111 

2013 2017 

Reduce a great deal 0 0.0 0 0.0 
Reduce somewhat 0o o ooon oOo 11.1 
Keep about the same ` 2 500 — i 111 
Increase somewhat 1 250 °°} | —eoe 33.3 
Increase a great deal ™” 1 20 | 33.3 
Idon'tknow re i. 111 


University Assessment and Testing 
http://uat.okstate.edu 


6 








2019 OSU Alumni Survey 
Sports Media Respondents 


Demographics 
2013 2017 
Stillwater 4 100.0 9 100.0 
Tulsa | 0 oon oono o0 o 
Equally Stillwater or Tulsa 0 > 00 S. 0 o a eae 0 .0 Pas 
Online 0 0.0 0 0.0 
CO — ee, O oes 
Peace ec ce ce cece 
KS 0 2 
LA 0 1 
OK ee eee eee Io 
TX 2 0 
VA 0 1 
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2019 OSU Alumni Survey 
Sports Media Respondents 


Academic Satisfaction 


Please rate your degree of satisfaction with each of the following items: 





Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 





2013 2017 


1 25.0 4 44.4 
ik: ae, (.<: 2 33.3 
ono 00 © a 222 
ooo o0 ooo 0.0 
a ee 00 4 0.0 
re 00 O00 0.0 

2013 2017 


1 25.0 4 44.4 
me 3. 750 4.2. 22 
i 0 0060 3 4333 
l 0 00 0 ooo 
E 0 00 oO. 00 
l 0 00 o ooo 

2013 2017 


1 25.0 1 11.1 
a 2 00. T a 
a 0o 60 a 
ne 1 250o 5 56 
m 0 O00 4 a 
l 0 00 0 ooo 

2013 2017 


1 25.0 3 33.3 
a. 0o o oon 2 22 
o 2 6500 3 £4333 





University Assessment and Testing 
http://uat.okstate.edu 


8 





2019 OSU Alumni Survey 
Sports Media Respondents 





Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 
Neutral 
Dissatisfied 
Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Definitely yes 
Probably yes 
Uncertain 
Probably no 
Definitely no 














2 50.0 8 88.9 
= 2 500 O00 — 
oe 0 O00 T 44.4007 
a 0 00 0 ooo 
ae 0 000° 0 ooo 


Career Reflection 
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2019 OSU Alumni Survey 
Sports Media Respondents 


Not related 
Somewhat related 





Directly related 





Very well 1 25.0 5 71.4 
Adequately 3 70 o | 2 236 
Not very well 0 oo | oO o0 
Notatall |! 0 oo | wo o0 
Prefer not to answer sits 0 oo \ o a 
2013 2017 

Very Satisfied 0 0.0 4 57.1 
Satisfied ` 3 750 °° | 2 286 
Neutral ss 0 oo © i. 4 i43 
Dissatisfied 1 250 onn o0 
Very Dissatisfied 0o o oon a 4 00. 


*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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2019 OSU Alumni Survey 
Sports Media Respondents 


Current Job or Career 





Full-time 3 75.0 7 100.0 
Part-time ` cs 20 0 o0 
2013 2017 


Employed by graduation 
3 months after graduation 
6 months after graduation 
9 months after graduation 

1 year after graduation 





over 1 year after graduation 














Russell Reynolds Associates Project Manager 

Paycom Marketing Writer 

Salem Red Sox Production Manager 

Davis Law, PLLC Client Services and Marketing 
Women's Premier Soccer League Communications Director 





National Football Foundation & College Hall of Fame, Inc. |Assistant Director of Communications 


























Gannett Reporter 

The Wichita Eagle High school sports reporter 
Claremore Daily Progress Sports Editor 

Florida’s University Athletic Association Communications Assistant 
Tailgate Guys Regional Sales Manager 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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A corporation, partnership, or private business 
Military 

Other governmental entity 

Charity or other nonprofit entity 

Educational institution 

Other 

Prefer not to answer 


2019 OSU Alumni Survey 
Sports Media Respondents 








Technology skills 

Conducting research 

Extensive training 

Math skills 

Problem solving/analytic reasoning 

Speaking to a group 

Use of specialized machinery 

Use of specialized software 

Working with a diverse group of people 

Writing reports, memos, papers, publications, etc. 


3 75.0 5 71.4 
m 3 70 45 14) 
ee 1 20 at 143 
os 1 2500—C—é—é<“‘<CW*“‘(‘<‘éi CS! 





0 0.0 1 14.3 
a 3 750 #46 857 — 
ae 3 70 46 857 | 
Wa 3 70 7? 100.0 — 





Less than $15,000 
$15,000 but less than $25,000 
$25,000 but less than $35,000 
$35,000 but less than $45,000 
$45,000 but less than $55,000 
$55,000 but less than $65,000 
$65,000 but less than $75,000 

$75,000 but less than $100,000 
$100,000 but less than $125,000 
$125,000 but less than $150,000 
Over $150,000 

Prefer not to answer 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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2019 OSU Alumni Survey 
Sports Media Respondents 


Updates to the journalism building and technology 





Upgrade the Paul Miller School of Broadcasting & Journalism building 


Building a job network with alumni and companies to further enhance hiring of grads (internships and careers) in a 
difficult, shrinking job market in my field (journalism/media). 


Better awareness of groups 











Make me feel more included 


have more classes focused on the insight to the actual work force. Not all internships did a great job showing what 
the day to day and week to week look like whether that’s in an office setting or different. 


| learned so much at Oklahoma State, especially in my field, and remain in contact with many of these professors 
that taught me invaluable skills. However, a lot of my classmates and myself are often S.O.L. in additional similar job 
fields because my education was so specific and our industry is slashing jobs globally. 























OSU gave me depression because of my social interactions there. 
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Survey Report — Strategic Communication 


The OSU Alumni Survey is a survey designed to collect information about OSU graduated students. More 
specifically, it is designed to collect information on their career, educational achievements, and their experience 
with OSU. This information will be used to improve academic programs and student experiences at OSU for 
generations to come. This survey targeted alumni of undergraduate and graduate programs who received their 
degree in 2013 and/or 2017. The survey was administered online by OSU-University Assessment and Testing 
(UAT) in April 2019 through June 2019. Departments may request additional information by contacting UAT 


(assessment@okstate.edu). 


Survey Questions 


Respondents were asked 37 institutional level items. Institutional level items were given to all OSU alumni and 
the items consisted of six topics: continuing education, well-being and community, demographic information, 
academic satisfaction, career reflection, and current job or career information. 


Target Population / Response Rate — Strategic Communication 


Number of graduates (n) 92 108 200 
Number of survey respondents (n) 30 35 65 
Response rate 32.6% 32.4% 32.5% 


2019 OSU Alumni Survey 
Strategic Communication Respondents 


2013 2017 


Not engaged in paid employment, nor enrolled in 


graduate or professional school —  — g E 9 -0 S wi o AA AREN 
Enrolled in graduate or professional school 1 3.3 5 14.3 
Employed full-time or part-time 25 83.3 30 85.7 


Both employed (other than graduate assistant) and 
continuing my education 


Self-employed 








Engineering 0 0.0 0 0.0 
Computer Science, Programming or Technology st O00 00 | Ot 00 
Science, Social Science, or Mathematics | OI 00 | Ot 00 
Health or Mental Health a 330° | OI 0.0 
Business or Management ts a 67 0 00 2 57 
Finance or Accounting st ooo 00 | OI 00 
Education, Training, or Library n 100 | ae 57 
legal Too 33 ts:t~CS a 57 
Writing, Journalism, or Design ~ 40000 a2 | i 4 29 
Public Service, Policy, or Politics ` 2 67 0 00 2 57 
Public Relations, Marketing, or Sales ` 2 400 24 600 
Architecture sis OI 00 | OI 00 
Art, Performing, or Athletics i ie: a. ooo ic 4 29 
Participating in a volunteer or service program tis ooo 00 | Ot 0.0 
Serving inthe U.S. military = O07 00 | OI 00 
Other occupational area (INSERT FIELD) st 40000 a2 0 ¢°«° #4 400 114 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Continuing Education 


2013 2017 





Graduate Certificate 
Master's 


Doctoral 


Medical (includes nursing, osteopathy, dental, vet, and 
more) 


Law 
Other (INSERT FIELD) 
Prefer not to answer 


1 20.0 0 0.0 
a Se 800 | 3 (iC 
a 0 oo 14 14.3000 
E 0 oO oO. ooo 
a 1 200 = 2 286 — 
E 0 OO T 14.3005 
E 0 oO o ooo 


Baylor University 

Oklahoma Baptist University (transferring) 
Oklahoma State University 

Southeastern Oklahoma State University 
Stetson University College of Law 

UC San Diego 

University of Kansas 

University of Leeds 

University of Notre Dame 

University of Oklahoma 


Very well 

Adequately 
Not very well 
Not at all 


Prefer not to answer 















*For items 3 through 5 do not include alumni who responded: ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’, ‘Employed full-time or part-time’, or ‘self-employed’ in item 1. 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Well-being & Community 


Very connected 
Moderately connected 
Somewhat connected 

Not very connected 


Yes, with my advisor(s) 

Yes, with professors or staff 

Yes, with members of my team, club, or sorority/fraternity 
Yes, with classmates/friends | met at OSU 

No 


3 12.5 11 33.3 
A 10 A7 o o ©6973 
gooo 375 2 2 10 30.3 
2 o oo 83 0Cti“‘i‘CS 3o 91o 
2013 2017 


1 4.2 0 0.0 
a 167 | 400 121 
B 8 333 414 424 — 
a 19 792 2 818 — 
ae: to AQ a2 

2013 2017 


Very Much 15 62.5 19 57.6 
Somewhat 9 875 oo 1 |2 o 3 6.4 S 
Litte =| 0 0.00 i 3.0 
None —s=s 0 00 — oe 3.0 





More than once a week 


About once a week 

About once a month 

Every few months 

Once or twice in the past year 
Not at all 





4 16.7 1 3.0 
a ek - en i 0 
m 7 22 4 30 | 
m 5 208 ET — 
—_ 6 2.0 £4.18 545 — 
o oOo 420 BL 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


How would you change the emphasis OSU placed on these aspects of education and 


college life? 





Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 


| don’t know 


Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


0 0.0 0 0.0 
aa 0 00 0 ooo 
a 1 o a58 20 (tC 
C7 2n 6 182 °°” 
| 5 28 5 4.152 
a to AQ a2 a 

2013 2017 








Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 


| don’t know 





0 0.0 0 0.0 
00 00 O00 0.0 
~~ 12 500 413 394 — 
=~ 5 28 15 £455 | 
ae 7 22 4. 124° 
l 0 00 E 
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Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


Reduce a great deal 
Reduce somewhat 
Keep about the same 
Increase somewhat 
Increase a great deal 
| don’t know 


2019 OSU Alumni Survey 
Strategic Communication Respondents 


2013 2017 


0 0.0 0 0.0 
i: ie is: i 30 
n 3 Bo o 7 A2 
a 1o o as e tS 
a 6 21 £48 22 — 
4 2000 BF BQ 

2013 2017 

0 0.0 0 0.0 
l 0 00 0 ooo 
D 7 22 410 w 
a 7 %2 B 8H 
a 9 3875 9 273° — 
— le - rr re 

2013 2017 

1 4.2 0 0.0 
a 00 T ooo 
a 9 375 °° &42£»10 ao 
~ 8 333 413 394 — 
ss 5 28 8 242 — 
= a i i: aa 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Demographics 
2013 2017 
Stillwater 23 De ct c 100.0 
Tulsa er 4200! eon, 0.0 o 
Equally Stillwater or Tulsa 0 si re, 0 Feces a 0 ).0 ee 
Online 0 0.0 0 0.0 


> 
A 
ro) 


co 2 0 
DE n n o a 
m cara IO 
e7 
INQ a 
C 
MNU S oo ooon 
MO o | ; «| 
NY o nnna o a 
Ok .-—.—(C Ww 460 
OR 
TN a 
TX rs 6 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Academic Satisfaction 


Please rate your degree of satisfaction with each of the following items: 





2013 2017 





Very Satisfied 7 30.4 6 18.8 
Satisfied 15 652 | a oo 65.6 
Neutral ` 1 o ee —_ 4 125 ae 
Dissatisfied a 00 44 34 — 
Very Dissatisfied a | 00 © 0 | 00 o 
Not applicable OO 00 
2013 2017 


Very Satisfied 8 34.8 6 18.8 
Satisfied ` 4 +4609 °°} © 1~S 50.0 
Neutral sis 0 oO | 5 15.6 
Dissatisfied 1 89430 °¢°¢-0. ; | 156 
Very Dissatisfied | 0 oo | o | 00 | 
Not applicable ss 0 oo | io” ~~ 0.0 | 
2013 2017 


Very Satisfied 4 17.4 5 15.6 

Satisfied = 1000 4350 © 0 8©=©S 313 

Neutral ss 6 ; (26. ; | 7 84.9 B 

Dissatisfied 2 Be as 8 250 y 

Very Dissatisfied 4 AB ee 1 ; een 3.1 a 

Not applicable S ooo 31 
2013 2017 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 
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Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 
Neutral 
Dissatisfied 
Very Dissatisfied 
Not applicable 


Very Satisfied 
Satisfied 

Neutral 
Dissatisfied 

Very Dissatisfied 
Not applicable 


2019 OSU Alumni Survey 
Strategic Communication Respondents 


2017 








Definitely yes 15 HAR 19! 59.4 
Probablyyes 8 NT So æ 
Uncertain 3 ooo B00 a 63 
Probablyno 0 000 O OOOO Eoo 31 
Definitelyno ss oo 0.0 1 3.1 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Career Reflection 
2013 2017 
Not related 2. 8.7 Sept 6 2. 2 0.7 a 
Somewhat related 1 Mua 4 78 Y 10 o 3 4.5 S 
Directly related 10 43.5 13 44.8 





Very well 7 30.4 9 31.0 
Adequately 133 565 ooo 5 ~~ i 517 
Not very well mE 2 a: ng 4 i 1 13.8 _ 
Notatall oo ag a 34 
Prefer notto answer en ii ee 
2013 2017 
Very Satisfied 
Satisfied 
Neutral 
Dissatisfied 





Very Dissatisfied 


*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Current Job or Career 





Full-time 22 95.7 28 96.6 


Part-time 1 4.3 1 3.4 





Employed by graduation 

3 months after graduation 

6 months after graduation 

9 months after graduation 

1 year after graduation 

over 1 year after graduation 






























































College of Liberal Arts, The University of Texas at 

Austin Digital Content Producer 
Mindshare Senior Associate Strategist 
GiveHear Marketing Coordinator 

Autry Technology Center Public Relations Coordinator 
[The Encompass Group Recruiter 

Kyvos Insights [Account Executive 

Reaching Souls International Communications Coordinator 
Fathom Events Marketing Manager 

National Reining Horse Association Youth Programs Advisor/Communications Coordinator 
Grand Prairie Independent School District Teacher 

Seton Foundations Strategy Manager 

Diana R. Garland School of Social Work with Baylor 

University Assistant Director of Admissions 
MultiView Sr. Content Marketing Strategist 
Orkin Pest Control Sales inspector 

Rokkan Media Social Media Strategy Associate 
Southwest Airlines Flight Attendant 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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2019 OSU Alumni Survey 
Strategic Communication Respondents 


Ponca City News 


Senior Classified Account Manager 





Griffin Communications 


Newscast Producer 





Cubic Inc. 


Digital Strategist 





(Aluminum Association 


Public Affairs Specialist 





WEHCO Video, Inc. 


Marketing Consultant 





Oklahoma City Zoo and Botanical Garden 


Social Media Content Coordinator 





Tulsa World 


Multi Media Advertising Consultant 





City of Liberty, Missouri 


Marketing and Special Events Supervisor 





Express Employment Professionals 


Online Learning Coordinator 





Kiewit Engineering & Design Co. 


Marketing Specialist 





Bridges Strategies 


VP of Project Management 





Love's Travel Stops and Country Stores 


Digital Media Production Specialist 





University of Missouri-Kansas City Foundation 


Donor Relations Specialist 





TNT Dental 


[Account Manager 





Inceed 


Senior Technical Recruiter 





Oklahoma House of Representatives 


Legislative Assistant 





St. Thomas the Apostle Catholic Church 


Echo Apprentice 





Skyline Media Group 


Social Coordinator 





TMT Oklahoma, Inc. 


General Manager 





Where Food Comes From, Inc. 


Marketing Coordinator 





Nike Factory Store 


Sales Associate 





Claremore First 


Preschool teacher 





TEAM Professional Services 


TEAM Lead | Implementation 





Moore Public Schools 


Teacher 





Opcity INC. - Realtor.com 


Business development 





Coppell ISD 


Teacher 





Boy Scouts of America 


Development Director 





Event Architecture 


Sales Consultant 





White’s Chapel United Methodists Church 


Content Manager 





Enterprise Holdings 


Sales Communication Coordinator 





Oklahoma Dental Association 


Special Project Manager 








Top Corner Marketing 








Marketing Administrator 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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A corporation, partnership, or private business 
Military 

Other governmental entity 

Charity or other nonprofit entity 

Educational institution 

Other 

Prefer not to answer 


2019 OSU Alumni Survey 
Strategic Communication Respondents 








Technology skills 

Conducting research 

Extensive training 

Math skills 

Problem solving/analytic reasoning 

Speaking to a group 

Use of specialized machinery 

Use of specialized software 

Working with a diverse group of people 

Writing reports, memos, papers, publications, etc. 


14 60.9 21 75.0 
E 12 522 14 500 — 
3 7 304 5 17.9) 
ce 5- O A7 o 4A o 





2 8.7 3 10.7 
—_ 4 69 °° °&«,£18 643 — 
a 19 = 826——“( wt 
_ 7 BS 20 o n4 





Less than $15,000 
$15,000 but less than $25,000 
$25,000 but less than $35,000 
$35,000 but less than $45,000 
$45,000 but less than $55,000 
$55,000 but less than $65,000 
$65,000 but less than $75,000 

$75,000 but less than $100,000 
$100,000 but less than $125,000 
$125,000 but less than $150,000 
Over $150,000 


Prefer not to answer 





*For items 26 through 35 do not include alumni who responded ‘not engaged in paid employment, nor enrolled in graduate or 
professional school’ or/and ‘enrolled in graduate or professional school’ in item1. 
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Required classes in personal budget and finance prior to graduation. Given adequate funding to the School of 
Journalism, ESPECIALLY the facilities. 

OSU could have invested more money into the journalism school and quality professors who have real experience in 
the advertising world. 

| would have liked to of had more required graphic design classes that allowed you to work with print vendors and 
how that process works. | also would have liked a few more professor options for some classes. Of course, students 
have the responsibility to adequately perform in a class, but not every teaching style is right for every student and if 
the student just can't follow a specific teaching style well it can be a great hindrance. 

Make a blend of Marketing and Business. A ton of advertising majors and business majors end up in Sales. Provide 
more courses for hybrids. 

| received a degree in Strategic Communications, and due to the broadness of the degree, | was unsure as to what 
type of jobs | should apply for, or even which positions existed (by title). When searching on sites like Linkedin or 
Indeed, it is important to know exactly what to look for...and | didn't. | would type in broad terms like marketing and 
communications or public relations and miss out on potential opportunities. 


Nothing, | had a wonderful experience! 


Have a class, during senior year, that specializes in after graduation success. Job applications, interviews, and 
others. We were required to participate in freshman orientation, we should do an exiting class that prepares us for 
real world experience. 

More strategic thinking; practical instruction on how to be successful in a work environment 

There were a lot of instances where my degree specific programs did not prepare me for real world scenarios. We 
had several classes where it was very easy to slack off or do enough to get by to make an A. 

Had a financial peace plan for students and a class for first generation students to see what to learn from college 
their sophomore year. 

Made the environment more inclusive and hired professors more mature 



































More specific field education and job exploration, more networking in the advertising industry 

| would have a class on employers benefits helpful. For example information on 401K investment, health insurances 
plans and financial investments in general. 

It was difficult to commute and made it hard to find meaningful internships/jobs while attending OSU. I've also found 
it more difficult to find work where I'm compensated fairly than before | attended OSU. Prior to finishing my degree, | 
had multiple years of experience, so it would have been nice to have more support for older students/continued 
education students and not fit them into the cookie-cutter advice from advisors. 

Focus more on a public relations career path for communications students (l.e. how to talk to a reporter, develop a 
message that aligns with a strategic plan, etc.) 


There is a lack of availability with much-needed courses. Every enrollment date was incredibly stressful. 

















| think it would be cool if internships were required. | feel like | didn't get a lot of on the job experience. 


More classes focused on practical skills vs theoretical knowledge. AP Style class was the most applicable one | took. 
More coursework about social media or BUSINESS (not personal use), social media advertising, booking advertising 
in general, how to pitch stories, working with media, how to interview, etc. 

| wish | had gotten more information on how to use the OSU job board - honestly | only remembered it after | 
graduated and even then | didn't really feel comfortable with it. 


Talk to students more about student loans and how those loans impact your future 


| loved OSU and will always be loyal and true. But, the buildings and classrooms were outdated during my time at 
OSU. Since | left, the new business building has opened and while | understand new facilities aren't free, | do think 
that the Journalism School could use a face lift. 

Taught more real life education, lessened the amount of credits | had to take that was totally irrelevant (electives like 
entomology), had better internship opportunities, had more job fairs, had better connections with businesses and 
corporations that hire people with the degree | was getting, adjusted curriculum to match what jobs are actually 
needing new hires to do rather than just teaching what has always been taught. 


The journalism building is pretty sad in terms of classrooms. It needs a major upgrade. 
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| think a required Gen-ed "lifestyle" class should be made for all Freshmen or Senior capstone. A class where you 
learn about Banking, Taxes, Mortgages, 401K's and Healthcare. All of that is vital to living on your own and 
something | never learned in a classroom setting. 

Career Services doesn’t work for every major. Greater emphasis on portfolio and writing work for Strategic 
Communication students, allowing them access to entry level jobs 


| think OSU lacks practical skills teaching (finances, business etiquette, etc. - especially in the Journalism school). 











Helping with budgeting skills, taxes and other life skills. Helping me really figure out what career | want. 

It's really my fault for not taking college as seriously as | should have, but turned out fine and have a great job paying 
me extremely well. 

Better academic advisors 

| wish there were more ways to get OSU related internships. | had to stay in stillwater and work full time between 


semesters so most internships weren't an option for me. More (both in quantity and field diversity) internships on 
campus would have been incredible. 


Although | am satisfied with my education, | know there were many things lacking from a budget point of view in my 
school (Paul Miller). We did not have access to enough platforms necessary for the job we would be doing post-grad. 
It seems quite obvious from a student point of view which departments mattered and which ones the university didn't 
care much about. 


| had a great time in Stilly at OSU and will cherish many of the memories | made there. 


























Great Campus, great experience, try not to lose Stillwaters old feel as you grow. 





| would be cool with receiving more alumni communications. 

| moved to Denver, CO after graduating, and | worked at a restaurant for a year before | was able to secure a job in 
my field. | had an amazing experience at OSU, and | wouldn't change a thing! | feel nostalgia for it all the time. 
Although | enjoyed most of my classes and learned a lot, my best experiences revolved around my favorite 
extracurricular activities - Latin Dancing and Cultural Club, Camp Cowboy, and Chi Omega. 

Overall, lm glad | picked my major and picked OSU. However, when | hear about other programs from other 
schools, | feel like their students were more adequately prepared for a job 

| loved ok state | have not found a job how every because | don’t have enough experience which is my fault but | 
would have liked a class teaching me how to handle my self to get the most out of my college experience 


I'm willing to share more with SMSC 

















| loved my time at OSU and | would never pick another school. Go Pokes! 


There are a lot of SMSC grads across the country that want to help create networks for current OSU students. Utilize 
that network to help broaden students’ perceptions of where they can go and what they can do with the degree. 

It was the best four years of my life. | miss it everyday and have so many wonderful memories. | made lifelong 
friendships, met the love of my life and received an incredible education. | wouldn't trade my time there for the world. 
Regarding the top ten seniors or top ten freshman honorary programs, | feel that the selection process is somewhat 
biased and favors Greek students heavily. For those individuals who pay for their own school, work through college, 
acquire internships, remain involved and get exceptional grades - it doesn't seem to hold as much weight as students 
who were a part of Greek life in college. Many of those individuals were not required to work, so their time was spent 
with Greek activities and volunteer opportunities. | feel this selection process should be re-evaluated and that the 
university should also focus on the individuals who are not involved in Greek life and also work incredibly hard for 
their future. 

In general, | had an awesome college experience. | loved every minute at OSU and it has definitely changed my life. 
10/10 would recommend 


| loved my time at OSU. Go Pokes! 




















The alumni base is incredible. I've met many friends at OSU and many more after. 











OSU gave way to so many opportunities and helped shape me into who | am today. 
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The Paul Miller Journalism building desperately needs to be modified. 
| talk HIGHLY about OSU and the program | was in. | would do it again. 


On the question "if you were to start over, would you still have attended OSU," | selected "probably not." It's nothing 
to do with my experience being negative! After 7 semesters, | realized that my true passion and career goal is 
filmmaking (thank you XXX and XXX) which isn't something you can focus on at OSU. If | could start over, | would 
have gone to film school instead of a traditional university. Go Pokes always though!! 
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